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ABSTRACT 



This dissertation investigates the problem of automatic 
transcription of the hand-keyed Morse signal. A unified 
model for this signal process transmitted over a noisy 
channel is shown to be a system in which the state of the 
Morse process evolves as a memory- conditioned probabilistic 
mapping of a conditional Markov process, with the state of 
this process playing the role of a parameter vector of the 
channel model. The decoding problem is then posed as finding 
an optimal estimate of the state of the Morse process, given 
a sequence of measurements of the detected signal. The 
Bayesian solution to this nonlinear estimation problem is 
obtained explicitly for the parameter-conditional linear- 
gaussian channel, and the resulting optimal decoder is shown 
to consist of a denumerable but exponentially expanding set 
of linear Kalman filters operating on a dynamically evolving 
trellis. Decoder performance is obtained by computer simula- 
tion, for the case of random letter message texts. For 
nonrandom texts, further research is indicated to specify 
linguistic and format-dependent models consistent with the 
model structure developed herein. 
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I. 



INTRODUCTION 



The problem of automatically transcribing the hand-keyed 
manual morse (HKM) signal with an acceptable error rate, 
without exact knowledge of the sender's keying character- 
istics and transmitted signal parameters, has, in general, 
remained unsolved. The easier companion problem of auto- 
matically transcribing a Morse signal sent by a keyboard 
(KAM) , and whose transmitted frequency is known, has largely 
been solved, and a number of Morse decoders are commercially 
available for this task. These decoders also can be used 
on the HKM signal, but with considerable loss in performance 
except in cases of very good keying quality. 

The difficulty of automatically transcribing the HKM 
signal (problems in frequency acquisition and detection 
aside) is often not recognized by the uninitiated. This 
difficulty is analogous to that of designing an automatic 
speech recognition device. While the analogy cannot be 
taken too far, certain parallels are evident. The HKM 
signal, being a human-generated process, has all the char- 
acteristics of individuality associated with such a process. 
No two senders of Morse send in exactly the same way, just 
as no two speakers speak in exactly the same way. Yet a 
trained Morse operator can understand what is being sent, 
just as a person who understands the language of a speaker 
can understand (almost) anyone who speaks that language, 
whatever the individual characteristics of his speech. A 
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Morse transcription machine for HKM which bases its deci- 
sions solely on the local Morse symbols (dot, dash, element 
space, character space, word space, pause) can, with some 
imagination, be likened to a situation in which a person 
who does not know English attempts to translate a spoken 
English phrase by isolating the syllables of the words. 
Clearly the Morse transcription task is not quite so diffi- 
cult as this analogy since there are only six "syllables" 
in Morse; yet the analogy is illustrative of the difficulty 
of transcribing the HKM process. 

On the other hand, the KAM signal can be likened to a 
teletype signal with a well-defined structure. Thus it is 
sufficient to decode such a signal on the basis of the baud 
structure, since there is a one-to-one mapping from the code 
words to the text. This non-singular mapping accounts for 
the relative ease of decoding a demodulated KAM signal. 

The above analogy has tacitly assumed that the Morse 
waveform was perfectly demodulated. In the real world of 
imperfect demodulation, it is clear than an HKM transcription 
machine which uses only local information, can provide no 
error-correction capability to correct incorrectly demodu- 
lated Morse symbols. Thus as a result of a single incorrect 
demodulation decision, an entire letter (two letters if the 
symbol was a character space) is transcribed incorrectly. 
Demodulation, therefore, must be considered as an integral 
part of the HKM processor, and this processor must have some 
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knowledge of the Morse "language” in order to provide error- 
correction capability. 

This paper reports the results of an investigation into 
the problem of automatically transcribing the HICM process. 

The problem is attacked from the point-of-view of optimal 
estimation and modern information theory. Theoretical results 
are derived which can be directly applied to the design of an 
optimal HKM transcriber. It is shown that such an optimal 
transcriber is unrealizable in the practical sense, but that 
a suboptimal transcriber which can be made arbitrarily close 
to optimal is realizable. Lower bounds on the theoretical 
error-rate performance of an ideal transcriber are obtained 
as a function of signal-to-noise ratio, keying characteristics, 
and HKI4 model complexity. The performance of the suboptimal 
transcriber is obtained by computer simulation and compared 
to the theoretical results for the optimal transcriber. 

Finally, the suboptimal transcriber is tested against a limited 
set of field data in order to validate the simulations. 

The report is organized into two parts: theoretical and 

application. In the theoretical section, a unified model 
structure for the HKIl process is derived which may account for 
code symbol dependencies, variation in data rate, operator 
sending anomalies, source letter context, message format, and 
linguistic dependencies. A channel model is constructed to 
account for transmitter, propagation, and receiver effects. 

The resulting modeled system is shown to be a system in which 
the state of the HKM process evolves as a memory-conditioned 
probabilistic mapping of a conditional Markov process, with 
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the state of this process playing the role of a parameter 
vector of the channel and measurement models. The joint 
demodulation, decoding, and translation problem is then 
posed as finding an optimal estimate of the discrete state 
of the HKM signal process, given a sequence of noisy measure- 
ments of the detected signal. The Bayesian solution to this 
nonlinear estimation problem is obtained explicitly for the 
case of parameter-conditional linear-gaussian channel and 
measurement models, and the resulting optimal Morse 
transcription machine is shown to consist of a denumerable 
but exponentially expanding set of linear Kalman filters 
operating on a trellis defined by the discrete state values 
of the parameter vector. Because of the exponential growth, 
the optimal estimator is unrealizable, and a realizable 
suboptimal solution which adaptively restricts the growth 
of the trellis is obtained. 

The application section shows how a specific model of the 
HKM process results from the general model constructed in the 
theoretical section. It is shown in principle how the 
generality of the model readily provides for any level of 
complexity in modeling an actual Morse message, i.e. from a 
very simple model of local Morse symbols up to and including 
a complex model of syntactic and semantic rules for the Morse 
"language." It is shown theoretically how context may be used 
to provide error-correction capability and reduce the lower- 
bound on output letter-error rate. Simulation results are 
obtained which confirm the expected improved performance for 
increasingly complex modeling of the Morse message. 
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II. PROBLEM DESCRIPTION 



The statement of the problem is actually very simple: 
Obtain a processor which will transcribe hand-keyed manual 
Morse as well as a human operator. The simplicity of the 
statement, however, belies the complexity of describing a 
"hand-keyed manual Morse" signal and the difficulty of 
quantifying the phrase "as well as a human operator." 

A. THE HAND-KEYED MANUAL MORSE (HKM) SIGNAL PROCESS 

As used throughout this report, the term HKM signal 
refers to International Morse Code and its derivatives sent 
manually by key, mechanical bug, or electronic bug. The 
baseband HKM process is the output voltage level of the keyer 
and is represented by the logic levels 0 and 1, corresponding 
to the states "key up" and "key down." The six symbols of 
the code are: dot , dash , element-space , character-space , 

word- space , and pause . The term element (or baud ) refers 
to the standard time unit of the code; its actual duration 
in seconds will of course vary with sending speed. Standard 
Morse code consists of the symbol durations shown in Table I. 

The standard word (including word-space) in Morse commun- 
ication is 50 elements in length. Thus the standard element 
duration in seconds for a given sending speed is 6/5 times 
the reciprocal of the speed in words-per-minute . The 
instantaneous data rate for an HKM signal is defined to be 
6/5 times the reciprocal of the duration of the symbol (in 
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TABLE I 



Standard Morse Symbols 



Name 



Symbol 



Duration (in elements) 



Dot 

Dash 

Element- space 
Char ac ter- space 
Word-space 
Pause 



W 



P 



14 



1 



1 



3 



7 



3 



seconds) divided by the standard duration in elements; 
e.g., the instantaneous data rate for a dash of duration 
60 msec is (6/5) / (1/. 020) = 60 wpm. 

An HKM signal differs from the standard Morse signal 
in that the instantaneous data rate is a random variable, 
resulting in symbol durations which are random. The element 
duration is defined to be the mean value of the dot duration; 
this mean value is also a random variable. The HKM signal 
may exhibit a large variation in both element duration and 
instantaneous data rate. The modeling of these random variables 
is discussed in section VI. A. The distributions of element 
duration and instantaneous data rate are unique to a particu- 
lar sending operator, and in most cases depend on the type 
of traffic being sent, and on the intended recipient of the 
signal as well. 
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B. THE HKM SIGNAL CHANNEL 



The HKI4 signal process is usually transmitted at HF by 
a transmitter whose final amplifier is on-off keyed (OOK) 
by the keyer, although in some cases, the oscillator itself 
is on-off keyed. Because of the effect of transients in the 
transmitter, the signal is usually chirped to some extent, 
the magnitude of the chirp being indicative of the quality 
of the transmitter design and state of maintenance. For 
well-designed, properly maintained transmitters, the chirp 
is on the order of tens of Hertz. Poorly designed or improp- 
erly maintained transmitters may exhibit as much as 300Hz 
chirp, as well as random drift of the nominal carrier fre- 
quency. Thus in most cases, signal detection must be accom- 
plished by using an envelope detector since the phase of 
the signal is not known. 

In addition to the signal uncertainties caused by the 
transmitter itself, the signal is also corrupted by both 
additive and multiplicative noise in the form of atmospherics, 
interference, and fading, which at HF is nonstationary. Thus 
demodulation of the OOK Signal must be accomplished in the 
face of frequency, phase, and amplitude uncertainty, along 
with incomplete knowledge of the noise statistics. 

C . OPERATOR PERFORMANCE 

The ultimate goal of the Morse transcriber is to provide 
output copy with an error rate approaching that which a 
typical human operator provides . The human operator rapidly 
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adapts to changing signal and channel parameters and can 
provide reliable copy of a highly variable HKM signal in the 
presence of numerous other Morse and non-Morse signals. The 
operator is obviously aided by an understanding of the context 
of the message, the format, and the Morse "language." 

The available data on operator performance is summarized 
in Figures 1 and 2. Figure 1 is a plot of error rate vs. 

SNR for an actual communications link in the LF band reported 
by Watt et. al. [1] , while Figure 2 shows the performance 
obtained in a laboratory experiment [2] . Both tests were 
conducted using random five- letter code groups as the test 
message. Table II, from Lane [3] , shows the nximber of dB 
which must be added or subtracted from the abscissa of the 
performance curve to obtain the performance for different 
speeds of transmission. Clearly the laboratory tests show 
a better performance capability for the human operator than 
that obtained for the actual communication link, with a 
difference of about 2-3 dB for equal error rates. Such an 
observation indicates that one must design the automated 
transcriber using the laboratory performance measurements 
in order to obtain the required performance under field 
conditions for the same SNR. 

The error rates discussed above were obtained using a 
text consisting of indepehdent letters (5-letter code groups). 
For a text which has more structure than random letters , 
whether through linguistic content, known message format. 
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TABLE II 



OPERATOR PERFORMANCE ADJUSTMENT FACTOR 
FOR SENDING SPEEDS 
(FROM LANE [3]) 



RATE 


FACTOR 


(wpm) 


(dB) 


10 


-5.0 


12 


-3.6 


14 


-2.3 


15 


-1.8 


16 


-1.4 


18 


• 

O 

1 


20 


0 


25 


1.6 


30 


2.6 



or increased semantic content, the human operator will take 
advantage of the structure to effectively reduce his average 
error rate. His error rate, however, for those portions of 
a message which exhibit uncertainty equivalent to independent 
letters, will remain at that for independent letters. Thus 
although his error rate for those portions of a message 
which have a high information content will not decrease, 
the transcribed message will be much more "readable," and 
the more costly errors will be much easier to locate in his 
output copy. As an example of "readability", consider the 
two messages shown below, each with a 10% error rate, including 
spacing errors. The first message is of low information 
content and is readable, although with some difficulty; the 
second is a message with higher information content. (These 
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two messages were generated by using a random number generator 
to obtain the errors, which may not correspond to typical 
morse substituions . ) 



Message 1; 

THIS IS AN RX A9P LE OF EN G LI SH TE XT 
WITH AN ERROR RATE OF 10 PERCENK. THC 
ERRORS INCLUDE SPA CING BETWEEN LE TTERS 
AS WELL AS THE WPlD SPACE. MS CANS E 
SEEN, THIS TEXT IS ON TH E THRESHOLDO F 
ACC EPTABILRTY AN D REQUIRA 2 SlAE 
DIFW8C U LTX TO R EAD . 

Message 2 : 

BM GEZRGE P BURDELL TO JOXN BUUYEL 

L123 EASW S T BEW YORK BT 

PSE C ALL NAMP HO NE NO 555 1233 AND 

TELL SIM WILL NOW DRR IVE KENNE DY 

AVTAN 17 38 12 JU LFLT NO 63 

WILL DEPANT FOX WAMH AT 231 9 12 JUL. 

The obvious point of this exercise is that average letter 
error rate alone is not a definitive measure by which the 
efficiency of a transcriber (either human or machine) can 
be judged, except for messages consisting of random letters. 
Secondly, it is clear that an automatic transcriber which 
does not use the message context and structure (linguistics, 
semantics, format) to decode the received message will not 
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be capable of producing a transcript as readable as the 
human operator except for random letter texts. 



23 



III. LOWER BOUNDS ON ERROR RATE 



In this section, information theoretic concepts are 
applied to the problem of decoding and translation of the 
Morse signal. Lower bounds on the performance of a trans- 
cription machine are obtained as a function of signal-to- 
noise ratio, keying quality, and decoder complexity. A 
channel model appropriate for studying the performance in 
this context is derived and its capacity determined. Source 
code models for the Morse code are also obtained, and together 
with the channel model, are used to derive a lower bound on 
decoded letter error rate. Although the average letter 
error rate, as argued in the previous section, is not a 
sufficient criterion for measuring the utility of a trans- 
cription machine in specific cases, it nevertheless provides 
a great deal of insight into the problem of determining how 
complex a decoder must be in order to approach the perfor- 
mance of a human operator. In order to obtain some intuitive 
appreciation of the Morse code as a source code, estimates 
of the entropy of a Morse-coded source are first determined 
under various assumptions about the source and the code. 

A. ESTIMATION OF MORSE-CODE ENTROPY 

The source entropy for a symbol -by- symbol decoder is 
obtained by considering the source to be an ensemble of 
Morse symbols each sent independently with probability equal 
to the expected relative frequency of occurrence of that 
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symbol. A decoder which is designed according to a model 
of the source as a Markov chain results in a source entropy 
calculated on the basis of that same Markov model. Thus 
various levels of model complexity result in corresponding 
levels of source entropy, as seen by the decoder. For 
independent symbol sequences the source entropy for an 
alphabet of size M is given by [4] : 

M 

H = - E p (i) log p (i) 

i=l 

p(i) = relative frequency of occurrence of symbol i. 

For Markov sources the entropy is given by [4,p.68]: 

J 

H(u) = - Z q(i)H(u|s=i) 

i=l 

where q(i) = limiting probability of the state s = i; 

K 

H(u/s=i) = - E P. (a,)log P . (a, ) 

k=l 3 ^ ^ ^ 

i.e. the probability that source letter a^^ is produced when 
the Markov process is in state j at time 1 . 
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1 . Independent Symbols 



Consider first the case of a source modeled by 
independent occurrences of the Morse symbols. In this 
case the entropy is 

H = -P logP , . - P , , logP , u ~ P logP - P logP 

dot ^ dot dash ^ dash esp ^ esp csp ^ csp ' 

The relative frequencies of the symbols in random Morse 
are : 



dot 



= .26, 



dash 



= .24 



esp 



= .36 



csp 



= .14 



and the entropy is: 



H = .261og(. 26) - .241og(.24) - . 361og(.36) - .141og(.14) 

= 1.927 bits/Morse symbol 

Since there are 1.76 bauds per Morse symbol, on 

the average , the entropy in bits per channel digit is 

H = 1.927/1.76 = 1.09 bits. 

2 . First-Order Markov Process on a Symbol Basis 

The independent symbol model of Morse is actually 
only of passing interest since even the crudest of Morse 
models recognizes the fact that in Morse code a mark symbol 
(dot or dash) must always be followed by a space symbol 
(esp or csp) , and vice versa. 
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A first-order Markov model has the following 
approximate transistion matrix and limiting probabilities: 



dot 


dot 

0 


dash 

0 


esp 

. 7 


csp 

. 3 


q(i) 
.26 ~ 


dash 


0 


0 


.7 


.3 


.24 


esp 


. 55 


.45 


0 


0 


.36 


csp 


. 5 


. 5 


0 


0 


.14 



Using the formulas given above for finding the entropy of a 
Markov source, 

H(u|s=l) = -.71og(.7) - .31og(.3) = .8813 
H(u|s=2) = -.71og(.7)- .31og(.3) = .8813 
H(u|s=3) = .551og(.55) - .451og(.45) = .9929 
H(u|s=4) = -.51og(.5) - .51og(.5) = 1.0 

H(u) = (.26) (.8813) + (.24) (.8813) + (.36) (.9929) + (.14) (1.0) 
= .938 bits/Morse symbol 
= .533 bits/channel digit 

3 . Second-Order Markov Process On A Symbol Basis 

A second-order Markov process of the Morse Code has 
the approximate transition Matrix and limiting state 
probabilities as follows: 
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• ^ 


•V 




“V 


^ • 








q(i) 


• ^ 


~0 


0 


0 


0 


.55 


0 


.45 


0~ 


.187 




0 


0 


0 


0 


0 


.5 


0 


.5 


.073 


— /N 


0 


0 


0 


0 


.55 


0 


.45 


0 


.173 




0 


0 


0 


0 


0 


.5 


0 


.5 


.067 


• 


.7 


.3 


0 


0 


0 


0 


0 


0 


.187 




.97 


.03 


0 


0 


0 


0 


0 


0 


.073 




0 


0 


. 6 


.4 


0 


0 


0 


0 


.173 


or 


0 


0 


.97 


.03 


0 


0 


0 


0 


.067 



Again, using the formulas for the entropy of a Markov source, 
the entropy of the source for this model is found to be 

H = .858 bits/Morse symbol 
= .488 bits/channel digit 

4 . Independent Letters 

The entropy of a source which produces equally 
likely independent letters from an alphabet of size 36 
(26 alphabet letters, 10 numerals) is 

H = -log (.02776) = 5.17 bits/ltr 

The average number of Morse symbols per letter is 7.27, 
resulting in an average entropy for the Morse symbols: 

^avg ~ 5.17/7.27 = .711 bits/Morse symbol 

= .404 bits/channel digit 
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5. English Text [5] 



For a model of an English text source, producing 
equally independent letters, the entropy is 4.76 bits/letter 
Using the proper relative frequencies for the occurrence 
of each letter, the entropy is reduced to 4.03. A first- 
order model of English has entropy 3.32, and a second order 
model reduces the entropy to 3.1. A model which produces 
equally likely words of text has an entropy of 2.14. Thus 
if a decoder which properly uses context, linguistics, and 
message structure can be designed, then the entropy of the 
Morse symbol for English text can be as low as 2.14/7.27 

= .294 bits/symbol 
= .167 bits/channel digit 

In summary, then, it can be seen that there is 
considerable merit in using for design purposes a model of 
the encoded source based on independent or Markov letters, 
rather than a model based on a probabilistic description 
of a sequence of Morse symbols. (The various entropies 
are tabulated in Table III.) Given an optimal demodulator, 
a decoder which fully exploits the letter structure of the 
encoded source, then, can be expected to perform as well as 
the human operator for a source of independent letters. 

As discussed previously, however, any Morse message of 
significant interest does not consist of independent letters 
and the human operator easily exploits the decrease in 
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TABLE III 



ENTROPY OF MORSE CODE SYMBOLS 
AND CHANNEL BITS 



MODEL 


MORSE SYMBOL 


CHANNEL BIT 


INDEP SYMBOLS 


1.927 


1.09 


FIRST-ORDER 
MARKOV SYMBOLS 


.938 


.533 


SECOND-ORDER 
MARKOV SYMBOLS 


. 858 


.488 


INDEP SOURCE 
LTRS 


.711 


.404 


ENGLISH TEXT 
EQUI-PROB LTRS 


.655 


. 372 


ENGLISH TEXT 
FIRST-ORDER 
MARKOV LTRS 


.457 


.260 


ENGLISH TEXT 

EQUI-PROB 

WORDS 


.294 


.167 



source entropy by knowing the context, linguistics, 
semantics, and format of the message. Conversely, any 
decoder which does not exploit this decrease in source 
entropy can never match the capability of the human 
operator, although it may perform well enough in some 
cases to be of value. 
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B. IDEALIZED HKl-I CHAITOEL MODEL 



Since the objective here is to obtain lower bounds on 
error rate, and not an estimate of actual performance, it 
is appropriate to consider an idealization of the HKM 
process, the detection process, and optimum demodulation 
in the presence of white gaussian noise. As such, the output 
of the detector would be input to a matched filter whose 
integration time is equal to the element duration of the 
Morse code being received. Exact knowledge of the baud 
length is assumed in order that the matched filter can 
remain in synchronism with the incoming signal. Obviously 
no decoder for HKM can ever have such information with 
certainty, thus this idealization represents the best 
possible demodulator which can never be achieved in practice. 
Secondly, the error crossover probabilities (dot vs. dash; 
element-space vs. character space) are idealized to be 
discrete probabilities rather than considering duration 
densities for these symbols; the word-space is included 
as a source letter and the pause symbol is ignored for this 
analysis. Under these simplifying assumptions, the 
channel can be modeled as a discrete symmetric channel, 
as shown in Figure 3 . 
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MARK(l) 



6 



1 



SPACE ( 0 ) 




Figure 3. Idealized HKM Channel Model 

In this model, the crossover probability 6 is related 
to the Morse symbol crossover probability by defining 6 to 
be the probability which yields the same average letter 
error rate as the symbol crossover probability on the 
basis of an average encoded letter. Since the average 
letter of Morse code consists of 7 symbols and 12 channel 
bits, 6 is defined by the relationship 

E = (1 - 5) = (1 - P ) ^ 

s es 
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where E is the average sending letter error rate and P 

s e s 

is the corresponding symbol error crossover probability. 
It will be convenient to make the following definitions 



on the keying quality of a 

GOOD; E = .01 
s 

FAIR; E = .1 
s 

POOR; E = .25 
s 



HKM signal; 



(P 

es 


.00143, 


6 = 


.000837) 


<'“es = 


.0149, 


6 = 


.00874 ) 


= 


.0403, 


6 = 


.0237) 



that is, a good sending operator sends the Morse symbols 
such that the resulting code stream consists of encoded 
letters in which 1% contain at least one incorrect Morse 
symbol; a fair operator sends with a 10% error rate; and a 
poor operator sends with a 25% error rate. 

The crossover probability e is just 1 - P^, where P^ 
is the probability that the matched-filter demodulator 
announces the correct mark/space decision. This probability 
is obtained as a function of SNR by computing where 

Ej^ = signal energy during an element duration and = one- 
sided noise spectral density. The error probability £ is 
then obtained from the performance curve for the probability 
of error using either coherent or envelope detection, as 
appropriate, followed by a matched filter [6] . 

The channel shown in Figure 3 may be converted to the 
equivalent binary symmetric channel shown in Figure 4 by 
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1 



1 




Figure 4 . Equivalent HKM BSC 



defining the equivalent crossover probability, 

= p(l/0) E p(0/l) = £ + 5 - 25e 

Clearly if 6 = 0 (perfect keying), then £ = £, and if 

£ = 0 (perfect demodulation), then £ =5. 

eq 

Since this channel is symmetric, capacity is achieved by 
assigning equiprobable input binary symbols, and is given 
by 



C = 1 + £ log £ ^ + (1 - £ ) log (1 - £ ) . 

eq ^ eq eq ^ eq 

Table IV gives the channel capacity as a function of signal 
speed and SNR for the KAM signal using envelope detection. 

C. CALCULATION OF LOWER BOUNDS FOR LETTER-ERROR PROBABILITY 
A lower bound average letter error rate is easily obtained 
by using the Straight-line Bound for a binary symmetric 
channel [4, p. 163], To use this bound, it is necessary to 
know the number of codewords in the code , and the length 
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TABLE IV 



HKM 


Channel 


Capacity 


as Function of Speed 


and SNR 


Speed 


SNR 


E/No 




C 


(wpm) 


(dB) 

(lOOHz) 


(dB) 


(Envelope Det) 




50 


12 


15.8 


2 X 10 ^ 


~1.0 




9 


12.8 


2.5 X lO"^ 


.975 




6 


9.8 


2.7 X lO"^ 


.821 




3 


6.8 


1.1 X 10“^ 


.500 




0 


3.8 


2.3 X 10“^ 


.222 


30 


12 


18 


-5 

<10 


~1.0 




9 


15 


1.3 X lO""^ 


.998 




6 


12 


6 X 10~^ 


.947 




3 


9 


4.5 X 10“^ 


.735 




0 


6 


1.3 X 10"^ 


.443 


20 


12 


19.8 


-5 

<10 


~1. 0 




9 


16.8 


< io“^ 


~1.0 




6 


13.8 


7 X lO"^ 


.992 




3 


10.8 


1.6 X 10"^ 


.882 




0 


7.7 


8 X 10“^ 


.598 



(in binary digits) of the codewords. Additionally this 
bound only applies to stationary block codes, requiring 
construction of an equivalent stationary block code for 
Morse, which in reality is a code which produces variable 
length word sequences. Given an equivalent block code the 
appropriate relationship for the probability of codeword 
error, P^, is given by: 



35 






M 

1 V A 1 k ,N-k 

u S A, J e (1 - e ) 

M m=l 



N 

. „ ,N. n -T ,N-n 

n=k+l ^ ^*5 



where 



N = codeword length 



M = no. of codewords 



(^') ; 0 < n < k-1 

n — — 



n,m 



0 ; k+1 < n < N 



and k is chosen so that 



k-1 
M Z 
n=0 



(^) + Z A, = 2^; 
n ^=1 k,m 



0 < 



M 

Z 

m=l 



A, < M 
k ,m — 



(^) 



This result for is for a block code with M codewords, 
each of length N bits transmitted over a BSC with error 
probability The problem then is to construct a block 

code which is equivalent, in some sense, to the variable- 
length-codeword Morse code, then to determine the number of 
codewords and the length of the codewords for this equiva- 
lent code. Clearly the complexity of this equivalent block 
code will depend on how one chooses to model the human Morse- 
encoding process for the design of the decoder, i.e., encoding 
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symbol-by-symbol; symbol pairs, triplets, etc., letter-by- 
letter, letter pairs, 3-letter words, 5-letter words, etc. 
Additionally the codewords must be chosen so that the 
resulting encoded sequences are stationary in order to 
state that the statistical expectation represented by 
is the same as the expected letter error rate (expectation 
over time) . This stationarity can be ensured by requiring 
the encoded sequence to begin at a random point within a 
source letter [7] . Such a requirement is equivalent to 
stating that the decoder is not synchronized with the encoder 
on a letter basis; that is, the decoder has no a-priori 
knowledge of the beginning and ending of a letter of the 
variable-length word sequence produced by the Morse code. 

Consider first the construction of an equivalent block 
code for Morse which is assumed to be encoded as a symbol 
pair. Table V shows the variable-length Morse codewords 
for this code. An equivalent set of equal length block 
codewords, on the basis of equal average codeword length, 
is shown in Table VI. It is to be noted that some code- 
words cannot follow other codewords in an encoded sequence. 
For example, the sequence 101011 cannot be followed by 
any codeword except those beginning with 10 since the 
sequence 11 and the sequence 1111 are not allowable Morse 
sequences . 

In principle, the same procedure can be followed to 
obtain the set of codewords for any desired codeword length. 
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TABLE V 



Variable-Length Codewords For Symbol Pairs 



Morse Symbol Channel Code 

10 

1110 

. 'v 1000 

111000 

01 

— 0111 

f\j* 0001 

000111 

Average No. of Channel Bits Per Morse Codeword: 4 



TABLE VI 

Equivalent Four-Bit Channel Mode For Symbol Pairs 



0000 


1000 


0001 


1010 


0010 


1011 


0011 


1100 


0100 


1101 


0101 


1110 


0111 




No. of Codewords: 13 





For sequence lengths greater than about 12 , however, the 
sheer number of possibilities makes this procedure intrac- 
table. For obtaining codeword sets for an encoder which 
encodes combinations of more than one source letter at a 
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time, then, another procedure is used. Although this 
procedure does not obtain all the codewords in the equiva- 
lent block code set, it obtains almost all of them and 
thus represents a lower bound on the actual number of 
codewords . 

The average Morse code sequence is 7.27 symbols in 
length. For a Morse code, however, the sequence length 
in Morse symbols must be an even number (it must begin with 
a mark and end with a character space) . By choosing an 
average of 8 symbols/character for the equivalent block 
code, and by requiring that the 8th symbol be a character- 
space, then, it can be seen that it is impossible to produce 
a sequence of a Morse symbols which does not represent some 
character. It is also obvious that not all characters are 
represented by this code. Now, of the four symbols, only 
two are allowed in any one position of the sequence (since 
space follows mark invariably and vice versa) thus the 
possible number of synchronous Morse sequences on this basis 
is 2^ = 128, and the minimum length of the codewords in 
binary digits is 8 x 1.76 = 14. To obtain the full set of 
nonsynchronous codewords, each codeword is shifted one bit 
at a time and a one or zero appended, if allowable, until 
no new codewords are produced. To illustrate, consider the 
synchronous codeword 10111011101000. By right shifting and 
appending a zero and one respectively, the two additional 
codewords 01011101110100 and 11011101110100 are obtained. 

On the next shift, note that the sequence 0110 is not legal. 
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so only three additional codewords are obtained: 1010..., 

0010..., and 1110.... In general, those codewords beginning 
with a dot (10) produce eleven additional codewords, and 
the codewords beginning with a dash (1110) produce eight 
additional codewords. If = number of synchronous code- 
words, then M /2 = no. of codewords beginning with a dot 
(dash) , so the total number of nonsynchronous codewords 
is given by 

M = 19 M /2 + = 10.5 M 

s s s 

Table VII gives the number of binary codewords (M) and the 

codeword length (N) for the encoding procedure of interest. 

For N £ 12, M and N are exact, as computed by the first 

procedure discussed above. For N > 12, M and N are lower 

bounds obtained by the second procedure. Using these values 

of M and N, the lower bound on P as a function of e is 
' e eq 

obtained. This value for P is the error rate over a code 

e 

of M codewords, and for the case of single character encoding, 
is the same as the average letter error rate. For other 
cases of source alphabet models, however, P^ does not 
represent the letter error rate, since letters consist of 
more or fewer than one codeword depending on the length of 
the codeword. To determine the letter error rate, E^, 
consider the following arguments. 
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TABLE VII 



Equivalent Block Codeword Set Size And Length For Morse Code 



Encoder 




M 


N 


Symbol Pair 




13 


4 


3-symbol 




33 


6 


Single letters 


(exact) 


395 


12 


Single letters 


(bound) 


1,344 


14 


Double Letters 




139,264 


28 


3-letter words 




22,020,096 
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Case 1: Letters consisting of two or more codewords. 

For this case, the distribution of codeword 
error events per letter is binomial with parameter P^. 

Let m be the number of codewords per letter. Then the 
probability of exactly k error events per letter is given 
t>y P ^ (1 - P and the probability of at least 

one error event per letter (i.e. the probability of a 
letter error) is given by E^ = 1 - (1 - 

Case 2: Codewords consisting of n letters. 

In this case, E^ is lower bounded by assuming 
that a codeword error event causes a single letter error 

within the codeword; then E. = P /n. 

36 S 

Figures 5-7 show plots of the lower bound on 
average letter error rate, E^, as a function of SNR and 
keying quality for several levels of assumption about the 
Morse encoding process. 
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FIGURE 5 . Lower Bounds on Letter Error Rate for 

Morse Code - KAM Signal, Coherent Detection 




I 
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13 



T" 

14 



FIGURE 6 . Lower Bounds on Letter Error Rate 
Morse Code - RAM Signal, Envelope 



Ej^Ato (dB) 
for 

Detection 
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Lower Bounds on Letter Error Rate for 
Hand-Keyed Morse, Envelope Detection, 
Random Letter Source 



IV. A GENERAL MODEL FOR THE HKM SIGNAL PROCESS 



In this section, a general model structure which accounts 
for message context, sender operator errors, variation in 
date rate, and variability of element duration is constructed. 
Further it is shown that various special cases of this 
model result in processes for which optimum estimation 
algorithms and decoders have been treated in the literature, 
some from the point of view of optimal estimation theory 
and others from an information theoretic viewpoint. 

Fundamentally the model that is constructed is a sliding 
block coder (SBC) with infinite memory. However, instead 
of encoding the letters of the text into the Morse symbols 
either noiselessly or with a fidelity criterion, the 
encoding process is considered as a probabilistic mapping 
of the output of the SBC. The complexity of the SBC is 
determined by the degree to which the Morse message is 
desired to be modeled, from the simplest case of independent 
symbols to a highly complex syntatic and semantic model. 

While specific complex models of a Morse message are not 
developed in this investigation, the structure for imple- 
mentation of such models is provided by the general model. 

Thus the structure proposed represents a unified approach 
to modeling the Morse message from the simplest case to 
the most complex. 
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A. BASEBAND HKM SIGNAL PROCESS 



The desired representation of the discrete-time baseband 
HKM process is a sequence of I's and O's who^e pattern of 
occurrence closely resembles that of a human operator sending 
a Morse text. By considering intuitively how a sending 
operator may encode the letters of the text, the random 
variables which influence the human encoding procedure can 
be recognized. Figure 8 is useful for visualizing this 
process . 




Figure 8. Morse Encoding Process 

At some time k, one or more letters of the text, 
are encoded into a sequence of code words a^^, consisting 
of the Morse symbols. The human operator, however, does not 
always send the proper Morse sequence for a given sequence 
of letters; typical mistakes are insertions and deletions 
of one or more symbols (particularly dots) , and substitutions 
of one symbol for another (particularly word-spaces for 
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character-spaces, and character-spaces for element-spaces) . 
Additionally the speed at which he is sending may vary over 
a period of time, depending on his alertness, proficiency, 
fatigue and the importance of the traffic being sent. 

The key converts these symbols into the 0,1 logic levels 
of duration consistent with the particular Morse symbol 
being sent. The length of time that the key is in a 0 or 
1 state, however, while determined principally by the Morse 
symbol being sent, is a random variable since the human 
operator cannot always produce repeatable, precise durations. 
The variability of the durations for each symbol, again, 
is dependent on the operator's proficiency, alertness, and 
individual sending habits. Consideration of these random 
influences leads to the model which is now developed. 

Let 

Xk £ {K^; i = 1,2}, the set of keystates; 

^k ^ ^ “ 1,2, ...6}, the set of code symbiols; 

J^k £ {Lj^; i = 1,2, ...N}, the set of source letters. 

Further, define the following finite state memory 

functions : 

(1) = ^3 memory associated with 

keying ; 



47 



<2) “k ' ^o<^k'“k-l>' 



the memory associated with 
encoding ; 



( 3 ) 






the memory associated with the 
source , 



where 



3k £ i 
«k ^ i 
^k ^ ^^i' ^ 



1 , 2 /...}, 
1 , 2 , ... }, 
1 , 2 , . . . } , 



the set of key memory states; 



the set of encoder memory states 



the set of source (message) 
states . 



Then the state of the process at time k is specified by the 
vector : 







where 



Sk ^ t==k'»k''‘k>''' 




[B. 



r a. 




For example, if f^ counts the number of samples since the 
last keystate transition, f^ counts the number of symbols 
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sent since the last letter transition and records the 
previous letter, then a specification of the state vector 
gives the current key state, code symbol, and letter being 
sent, along with the amount of time the key has been in its 
current state, which symbol of the Morse code sequence for 
the letter is being sent, and the previous letter. 

To introduce the randomness associated with sending 
errors and variation in data rate, let a random control 
vector be defined which selects the Morse code sequence for 
the letter being transmitted, controls the instantaneous 
data rate, and the average speed of sending: 



u, e {U.; i = 1,2,...M}, the set of control vectors. 
The complete state vector is now given by 

Hk 
^k 

The probabilistic evolution of the states of the process 
will be fully specified when the following transition 
probabilities are determined: 



= ‘k 5ik’’ ®k “k 



Pr [s^ = 



u 



= U., a, = Z 



-k -j ' -k 



^ ' — k-1 






-k-l 
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where 



{S^; i = 1,2 



/ • • • 



R} 



is the set of all state values 



and 



i = 1,2 



/ • • • 



Q} 



is the set of all memory states 



This state transition probability matrix is now derived 



Let the evolution of the keystate, which is dependent 
only on its present and past inputs and its past outputs 
be described by the transition probabilities; 



Similarly the evolution of the encoded letters a^^ from the 
decoder is dependent on the present and past inputs to the 
encoder and on its past outputs , but it is also dependent 
on the history of the keystate, since the code symbol being 
keyed cannot be changed until the current symbol has com- 
pleted keying. The transition probabilities describing the 
encoder function then are given by: 



in terms of the components of the vector 



(4) p(x 




A 
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The evolution of letters from the source is dependent on 
the history of the message text, but it is also dependent 
on the history of the encoding process, since the letter 
being encoded cannot be changed until the current letter 
has completed the encoding procedure. The transition 
probabilities for the source then are: 



(6) p{L\X 



k ' k-1 



“k-l^ 



A, = M. , 
k-1 j 



a, T = A ] . 
k-1 m 



The control vector u, is modeled as a conditional Markov 

k 

chain, conditioned on , accounting for the 

dependence of operator sending peculiarities and data rate 
on message context, message duration, traffic type, etc. 
The transition probabilities for this model are: 



<7) P<Hkl5ik-l “k-1 ®k-l Vl> = “ !iil!ik-l = !ij' 



a. 



:-l ^m' ^k-1 ®n' ^k-1 



In terms of the abbreviated notation defined by expressions 
(4) through (7) above, the state transition matrix is given 
in terms of the components of the state vector s^, by : 



PfSk ik ^kl^k-l ik-l 2k-l> = P'^k ®k ®k “k *-k \ Hk 



^k-1 ®k-l “k-1 ^k-1 ^k-1 ^ik-1* 
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Invoking the independence of appropriate variables argued 
in writing expressions (4) - (7) , this expression reduces by 
the chain rule to: 



(8) p(s,^ 2khk-i ' P'^^kl^k ^k-1 “k-l> • P'Ski^'k ^k-l> 

• P<^kl*k !ik “k-1 Vl ®k-l> • P<“k!^k “k-l> 

■ P<‘‘kl\-1 “k-i> • p<^kl“k Vi> 



P^-k'-k-l “k-l ^k-1 ^k-1^ 



Now the expressions for the transition probabilities of 
3k r are given by the following due to definitions 

(1) - (3) : 



p'Skl^'k Vi> = 



lo. 



if B. = f. (K . ,B ) 
1 3 3 n 



otherwise 



p‘“ki®k “k-i* = 



1, if A ■ = f (A. ,A ) 
1 a ' j ' n 



0, otherwise 



P*^k'\^k-1* 



1, if M. = fj(L.,M^) 



0, otherwise 
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Thus the transition probability (8) is zero for unallowable 
transitions, where the set of allowable transitions is 
given by (1) - (3) . The expressions for the state transi- 
tion probabilities (3) , then, may be written as 



(9a) Pd„ £„. 1 > = 



®k-l “k-l> • P<®kl*k !lk “k-1 Vl ®k-l> 



P'^kl^k-1 ®k-l* ■ P*5^kl-k-l “k-1 ®k-l ^k-l’ 



where the set of allowable transitions is given by 



(9b) f (s, ,a, ^ 

— a — K — K-i 



[fg(Xk, 






*a<^k'“k-l> 






Expression (9) , then is the desired description of the 
probabilistic evolution of the state of the HKM process, 
given in terms of the source (message) statistics, Morse 
encoding procedure, keying characteristics and data rate 
statistics . 

This model for the HKM process accounts for many effects 
which go into the generation of the key output logic levels. 
The extent to which the model accurately represents a Morse 
code stream is determined by the complexity of the memory 
functions f^, f^, f^ and by the proper assignment of the 
conditional transition probabilities. 
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For example, if the function is sufficiently complex 
and clever, the entire past context of a message may be 
accounted for in assignment of the letter transition 
probabilities. In the simplest case, the assumption is 
made that f^ = 0, and uniform probabilities are assigned to 
the letter transitions. The next level of complexity is to 
assume that f^ = allowing a Markov model for the letter 

transition probabilities. Considerably more complex is a 
model which recognizes that certain sequences of letters 
are always followed by a known sequence in certain formatted 
messages. The most sophisticated model for this function 
is one which models the structure of the Morse code message 
as a natural language, requiring construction of syntatic 
and grammar-like rules which are used to parse the message 
into meaningful sequences of letters and words. Such a 
model would obviously require a highly complex f^. 

At the next level, that of encoding the letters into 
the mark/space durations consistent with the dot/dash/space 
Morse sequence for the letter, any level of sophistication 
and cleverness for the f^ function may be used, together 
with the model for the vector control variable u. It is 
at this point that operator inconsistencies such as deletion, 
substitution and insertion of Morse elements can be accounted 
for. Additionally, by proper construction of the f^ function, 
one may also account for variations in weight (average 
dot/elem-space ratio), sending speed, and known conditional 
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relationships between the ratios of current to predecessor 

element durations. In the simplest case, the assumption is 

made that the operator always encodes perfectly and that 

his element durations are consistent. This simple case 

would apply to machine-sent Morse code and corresponds to 

the situation where u = constant, and f = a, , . 

— a k-1 

At the key, the durations aj^ are converted into the 
0,1 logic levels of duration roughly equal to that produced 
by the encoder. The human, however, cannot always produce 
these durations consistently; thus, the time duration in 
a particular state will be random, with mean value roughly 
equal to the durations produced by the encoding process, 
and with a variance inversely proportional to his proficiency 
and concentration. There are, for example, certain con- 
ditional relationships which have been found to be true for 
almost every operator; in particular, inter-element dots 
are more consistently produced than beginning or ending dots. 

At this point, also, the effect of the type of key used 
by the operator may be accounted for. Hand-keys, mechanical 
bugs, and electronic bugs all produce different duration 
statistics for the same operator with the same message. 

The purpose of this research is not to derive sophis- 
ticated models for the f-functions, but to derive a result 
which shows in general, whatever model is used, how the 
concepts of context, message formatting, operator encoding 
anomalies, and operator "fist” modeling may be included in 
a unified framework to produce at the receiver an optimal 
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estimate of the transmitted text. The extent to which the 



output translated text is an accurate reproduction of the 
transmitted message is clearly a function of the sophis- 
tication and accuracy of the model used. 

The results of this development of the model are summar- 
ized in the following simple theorem. 

Theorem 

Let S, be an n-dimensional discrete-valued random vector 
k 

with finite state-space: {S^; i = 1,2,...N}. 

Let U. be an m-dimensional discrete-valued random vector 
k 

with finite state-space: {U^; i = 1,2,...M}. 

Let Z, be an r-dimensional discrete-valued random vector 
k 

with finite state-space: {A^; i = 1,2,...R}. 

Define the function f ^ x -*■ Zj^ such that 
= f^(Sj^,aj^ , where are realizations of the random 

processes 5j^,Zj,/ respectively. 

Let the probabilistic evolution of the process be 
described by the following conditional Markov process : 

P<“kl“k-1 “k-l> - = “ji“k-l = “m- °k-l ' 

all j , m, Z. 

Let the probabilistic evolution of the Sj,-process be 
described by the following conditional probabilistic mapping 
of the U, -Markov process : 
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«j' “k-1 = “4- 



p<=kl“k “k-1 “k-l’ = p^'^k = ®il“k = 



= A^] , all i, j , 2., n, 



Then, the output state of the HKM process described by 
equation (9) results from a probabilistic mapping of the 
Markov control vector Uj^, conditioned on the entire past 
history of the output state. 

Proof : 

First, it is clear that the function f^ records the past 
history of the output state Sj^, since 



= *o'=k'“k-l> - 



*a<=k'*o<®k-l'®k-2>> 



= *o<=k'^o<Vl'*o<®k-2' 



f„(Sj,Oo)) 



Second, expression (9a) reduces by the chain rule to; 



^<^k ^kl^k-1 ^k-1^ = P^^k'^k ^k-1 



^k-1^ 



P^^kl’^k-l '^k-l^* 



Corresponding the terms on the right-hand side with the Sj^, 
Uj^ processes described above, and expression (9b) with the 
f^ function, the theorem is proved. 
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Corollary 



Let the function f be invertible in the sense that 

o 

s, = f_ ^(a, ,a, ,) is uniquely defined. 

K OS K K*“ 

Then the output state of the HKM process is a sliding 
block encoding of the sequence Sq,Sj^,S 2 Sj^, where the 

evolution of the process is described by the conditional 
mapping : 



“k-l> = = ®il“k-l ' “j' “k-1 = V 



and the process is described by: 



P^'^kl’^k-1 ^k-1 ^k^ ^il’^k=l ^j'^k-1 ^ 



ra 



a 



k 




Proof: From the main theorem, the state a, is describeable 

k 

as : 



“k = ^o<=k'*o<=k-l'*o'=k-2' ••• ^a<=l' 



which can be expressed in terms of a new function f^ as 



^k ^a^®k'®k-l'®k-2" * •®1''^0^ * 
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Now, defining = Sq, which is consistent with (9b) since 
is arbitrary, then represents a sliding block 
encoding of the sequence {s^}, i = 0,1, ...k. 

Now (9a) can be expressed as: 



p<=k °k-i> ' p<“ki“k-i °k-i • p'®ki“k-i “k-i> 



and by the corollary hypothesis on the invertibility of f^. 



= P<"kl'^k-l °k-l • P<=kl"k-1 “k-l>- 

But Uj^ is already conditioned on , so the additional 

conditioning provided by s, = f ^(a, ,a, ,) is exactly 

that provided by CTj^, thus (9a) is reduced to: 



p<=k “ki“k-i °k-i> = p<"ki"k-i “k-i °k> • p‘=ki"k-i °k-i>' 



which are the two processes hypothesized, proving the 
corollary. 

Comments: The theorem and corollary are interesting pri- 

marily from a theoretical viewpoint. The main theorem 
actually does no more than place the intuitively developed 
model for the HKM process on a solid probabilistic founda- 
tion. In Section V, where an optimal estimator for the 
state of the process is derived through Bayesian techniques, 
the form of the model presented in the main theorem is that 
which is used. However, after the estimation algorithm has 
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been derived, it is shown that the optimal estimator has a 
trellis structure, which is not surprising in view of the 
corollary result showing an SBC interpretation. The block 
diagram shown in Figure 9 is useful for visualizing the 
evolution of the output state, Sj^. 

B. BASEBAND HKM CHANNEL MODEL 

Although the channel model for the HKM process described 
in Section III was useful for obtaining lower bounds an 
error-rate performance, it is of little use in actually 
describing the physical processes which affect the reliable 
transmission of a Morse message. Consider the following 
simplified model of the communication channel for Morse 
transmitted at HF. The keyer turns the transmitter on and 
off according to the HKM source. When keyed, the transmitted 
RF signal has amplitude C(t) at a carrier frequency to. The 
HF propagation channel introduces both additive noise (N(t)) 
in the form of atmospherics and interference, and multipli- 
cative noise (B(t)) in the form of fading and multipath 
propagation effects. At the receiver, the carrier is 
removed after being band-pass filtered and gain-controlled. 
After low-pass filtering and sampling, the baseband signal 
is given by Cj^ bj^ + n^,, where c^^ is the sampled, 

gain-controlled received signal amplitude; bj^ is the 
sampled, gain-controlled, low-pass filtered effective 
multiplicative noise component; and n^, is the low-pass 
filtered version of the additive noise. 
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FIGURE 9. Block Diagram of HKM Signal Model 



The sampled version of the amplitude of the transmitted 
carrier is a constant value while Xj^= 1. During the 
period when = 0 , the amplitude will remain constant at 
the same value as for x^, = 1 for a large percentage of the 
time. However, it is not uncommon for the operator to go 
into a pause during which time he readjusts the transmitter 
power either up or dov;n. These adjustments are usually 
made between messages, but also can occur during a short 
pause between letters. Thus the signal carrier amplitude 
is a random variable with a transition probability density 
which is conditioned on the memory of the HKM process and 
the current key state. In the simplest case, the model may 
be made conditional only on Xj, and having, as a con- 

sequence, the result that the carrier amplitude is allowed 
to change randomly during every 0-state duration. More 
realistically, one level of complexity greater allows the 
transition probability to be conditioned on such that 

the amplitude can change only when indicates a pause. 

The effect of transmitter power fluctuations at the output 
of the receiver is dependent on SNR and on the AGC employed 
for gain- leveling. For moderate to high received SNR, the 
effective c^, observed at the receiver output stays relatively 
constant because of AGC action. However, when noise power 
becomes a significant portion of the total power controlling 
the AGC, then c^, varies nearly the same as C^,. Thus an 
efficient model of transmitter power fluctuations must take 
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into consideration not only the actual power variations of 
the transmitter, but also the effect of the receiver RF, 

IF, and AGC sections as well. 

Consider now the multiplicative noise term, which has 
the observable effect of varying signal amplitude. If it 
arises because of relatively slow fading, then its effect 
will be cancelled by the combination of AGC and low-pass 
filtering. If, on the other hand, it is caused by fast 
fading (perhaps due to multipath) , then the AGC cannot 
respond fast enough to keep the output signal-level constant. 
On an OOK signal, the effect is the same as if the trans- 
mitter power were changed during the carrier off-time. 

The term then, represents an effective transmitter 

power fluctuation, dependent on both the HKM process and 
the HF channel, with the result that the marks of the HKM 
process appear to be transmitted with random amplitude. 

During the period of a MARK, the effective fluctuations 
are caused by the slow fading component with intensity and 
rate determined by the channel, the AGC, and the low-pass 
filter. 

In view of the above consideration, it is appropriate 
to model the apparent transmitted amplitude y^, as a condi- 
tional gauss-Markov process, dependent on both the HKM 
process, and the channel: 

(10a) y(k) = YF(Sj^ '^k-l^ Y(k-l) + T(Sj^ ^k-1^ 
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where w^(k) is a zero-mean gaussian random sequence with 
unit variance; 

F(Sk is a function of the state of the HKM source 

r (Sk is a similar function, 

Y is a channel-dependent fading parameter. 

Now, since the amplitude is observed only during a MARK 
period, the measurement equation is given by; 

(10b) = Xj^yj^ + Uj^, 

where n^^ is the low-pass filtered, gain-controlled channel 
noise . 

Equations (10) represent the described HKM Baseband 
channel model, which accounts for the effects of fading on 
an OOK signal and the effect of actual transmitter power 
fluctuations caused by the sending operator. 

Generalizing these intuitive concepts to a vector 
channel results in the following channel-measurement model. 
Consider that the output sequence s^^ of the HKM is observed 
through the following channel and measurement processes : 

“k-i> ^k-i ^ '■<=k '^k-i' ”k 
\ = “'=k’ ^k "k 
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where 



is a p-dimensional state vector; 



is a q-dimensional measurement vector; 



J(S]^ is a p X p state transition matrix; 



H(s^) 



is a q X p measurement matrix; 



“k-i> 



is a p X p matrix; 



w. 



is a p-dimensional plant noise vector; 



n. 



is a q-dimensional measurement noise 
vector ; 



is statistically independent of for I k; 



nj^ is statistically independent of n^ for 5, ^ k; 



is statistically independent of n^^; 



p (yQ) ,p (Wj^) ,p (n^,) are given probability densities. 



It is to be noted that this observation model, when con- 
ditioned on is linear. Further if the probability 

densities are gaussian, then the Sj^ *^k-l ~ conditional 
estimate of y^,, given the sequence z^, k = 1,2,..., is 
given by the well-known Kalman filter recursions. 
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V. THE ESTIMATION PROBLEM 



The estimation problems of interest, based on the HKM 
source, channel, and measurement models, can be divided 
into two broad classes. The first results when the HKM 
transition and mapping probabilities are known a-priori 
for all k; the problem then is to find an optimal (in some 
sense) estimator for Sj^ and/or Uj^ given noisy observations. 

It will be shown that the desired estimator is not physically 
realizable in general because it requires an exponentially 
expanding memory. In Section VIII, however, practical 
realizations of a suboptimal estimator are discussed, and 
it is shown that one can systematically come as close to 
optimal estimation as desired. The second class of estima- 
tion problems results when the HKM model probabilities are 
known only to the level of an initial probability distribu- 
tion. The problem here is to estimate Sj^ and/or u^, and 
the transition and mapping probabilities themselves. Only 
the first class will be treated here. 

In this class of estimation problems, the transition 

and mapping probabilities are specified, and the problem 

is to estimate the state of the system at time k, given 

k A 

the sequence of all past measurements z = { , Z2 , . . . , } . 

The state estimate of the system is given by the joint 
estimate of the output, control, and memory states Sj^ u^, 

The problem of obtaining an optimal estimate of the state 
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is approached in the traditional manner; that is, the 

(posterior) conditional probability distribution 
k 

p(Sj^ Oj, I z ) is determined for all k, and a suitable 
optimality criterion is applied to this distribution to 
arrive at an optimal estimator. 

Using the Bayesian approach to the problem of obtaining 
the posterior distribution, a recursive form for the 
estimator is obtained. It will be shown that the resulting 
structure can be realized by a set of simpler, identical 
filters, operating on a tree or trellis. In the case of 
parameter-conditional linear-gaussian observation and 
measurement models, these "elemental" filters are Kalman 
filters. In case the observation and/or measurement models 
are not linear-gaussian, then the body of knowledge on 
non-linear filtering can be brought to bear on the design 
of these elemental filters. 

A. ESTIMATOR DERIVATION 

In the following it will be necessary to keep track of 

both the time index, k, and the state value indices for the 

states Sj^ £ {S^}, Uj^ e Cu^}, e To reduce the 

notational burden which would result from the explicit 

notation of probability statements such as 

Pr[s. = S . I u, = U.,u, . = U ,a, T = A ], the following 

k i' k j k-1 m k-1 n ^ 

abbreviated notation will be used. The subscript k is the 
time index, and the superscript is the index of the set of 
state values. When k is used as a superscript, it refers 
to the time sequence of values, 0,1,2,. ..,k; e.g.. 
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k A 

z = Zj^Z 2 . . • Zj^. Additionally the vector notation using 
an underbar will be dropped, with the understanding that 
all variables are implicitly vector-valued . In terms of 
this notation, the HKM signal and observation models are: 



(11) Output State Mapping probabilities: 



“k-l “k-l> - ' ^il'^k = = “m'°k-l 






(12) Control State Transition probabilities: 



p(uj|u^_l 0 ^. 3 ^) A Prlu^ . “jl“k-l = “m'“k-l = ''q' 



(13) Memory: 



af = f (si,a5 T ) = f (S. ,A ) 
k a k' k-1 a 1 q 



(14) Channel: 



^k ' ^<^k “k-i* ^k-i + '■<®k “k-l> 



1 Q 

rr ~ 



(15) Measurement: 



"k = “<=k> ^k * "k- 



The well-known Bayesian procedure (see, for example, 
Lee [8]) for recursively determining the posterior density 
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(distribution) is given as follows. At time k-1, the 
mixture density: 



/ I - / I n m q k-1. 

P(^k-1 ®k-l ^k-l'^k-l'^ ) = P^^k-J^k-1 ^k-1 ^k-1'^ ) 



, n m q I k-1, 

P^®k-1 ^k-1 '^k-ll^ ^ 



has been obtained. The density at time k, after receipt 
of a new measurement is given by Bayes' rule: 



(16) p(yj^ sj uj 



,1 i j S, k-1. , i j £ I k-1. 

P^^k'^k ®k ^k^k ^ )P(y> Si, u^ a^|z ) 



k k "k "k 



/ I k-1, 
P(Z]^|Z ) 



where : 



, i j £|k-l, 

(17) P(yj^ S^ Uj^ Gj^lz ) = 



Z 

nmq 



, i i £i nmq k-1, 

P'^k ®k "ic “klyk-i =k-i “k-1 “k-r^ > 



k-1, 



^k-1 



/ n m q I k-1, , 

p'^k-i ®k-i "k-1 "k-J^ > “^yk-i 



(18) p(Zj^|z'^''-) = 



z 

ij 



/ i j k-1, ,1 i j £ k-1, , 

P(Yk ujj a^|z )p(z,^|y^ s,^ u^ a^^;z ) dy 



k'^k ""k “k '^k' 
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The desired state posterior probability distribution 



then is obtained from (16) by integrating over y^,; 



(19) p(sj uj cr^|z^) = J uj cr^|z^) dy^^. 

k— 1 

Substituting expression (18) for P(z^^ z ) into (16), 
expression (19) becomes: 



,1 i j il k-l> , i j £| k-1, , 

^ “ic “k ^ \ "k Pki^ > '^k 



,i „j = 



(20) p(Sj^ Uj^ Cj^lz ) r i j £| k-1. , I i j k-1. , 

h J p‘^k =k \ “ki^ > p<\iyk \ “k ^ ^ % 



y, 



and the problem is to obtain a result for the integral over 
yj^ in terms of the prior density at time k-1, and the model 
transition probabilities. 

The first term in the integrand, P(Zj^|yj^ u^ z^ ^) , 
is readily determined from the measurement equation (15) 
and the density of the noise, Pji(^]^)- the case of n^^ 

a white sequence, the density is given simply by; 



(21) p(Z|^|y^ uj 0* z'^-1) E p(z,^|y^ sj) = p^(z^ - H(sJ)y,^). 



The second term in the integrand is given by (17) in 
terms of the prior density and the transition probabilities. 
Rewriting the mixture densities in (17) in terms of the 
component conditional density for yj^ and the discrete 
distributions for Sj^ u^, expression (17) becomes: 
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( 22 ) 



, i j £| k-1, 

“k “kl^ > ' 




k-1 



‘p'^k 






n m q 
^k-1 \-l ^k-1 



z^-1) 



' *S 



(a) 



, 1 1 X. I n m 

P<=k “k “kli'k-l =k-l “k-1 



q k-1. 

“k-r^ ) 



(b) 





1 n 


m 


q k-1, 

^k-1'^ ) 


(c) 


k-1 


l^k-l 


“k-1 


• — 1 
1 


m 

^k-1 


“?-i 




(d) 



Now since Sj^ Uj^ are independent of the density 

on line (c) above is not changed by writing: 




Also, by virtue of this independence, the expression on 
line (b) becomes; 



(f) 





q 

k-1 



Combining (a) & (e) , substituting (f ) for (b) , and rearranging 

the terms of (22), the expression becomes: 
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p<y)c “k “ki^ > ' 



i i il I n m 

• rr c? n 



n m 



k-1, 



2 p(Sj^ Uj^ ^k'^k-1 ^k-1 ^k-1^ P^®k-1 ^k-1 ^ 



nmq 



^ r^t,r ,, 1 ^^ ^ ,,^1 ^q _k~l, 



^k-1 



/ I X J X/ II ill u JS.— X» J 

p'^k ^k-ll^k “k "k =k-l “k-1 “k-1'-^ > “^yk-l 



Carrying out the integration over and noting that 

is not dependent on ®k-l '^k-l' desired result 

for expression (17) , in terms of the prior and transition 
probabilities, is given by: 



/'.ox / i j k-1, 

(23) p(yj^ Sj^ UjJ, Uj^lz ) = 



„ ,ij£rn m q,,n m^q i k-1, 

2 P(s^ Uj^ ^kl®k-l ^k-1 ^k-1^ P^®k-1 ^k-1 ^k-1 1 ^ 

n,m,q 



/ I i <3 k-1, 

p<i'ki®k °k-i'^ >• 



The integral in (20) is then given in terms of (23) 
and (21) as: 



(24) 



/ 



,1 i j £ k-l> , i j £| k-1, - 
p‘^ki^k ®k “k “k ^ > p'^k =k “k “ki^ > '^^k = 



„ ,ij£rn m q. ,n m ^q i k-1, 

^ p<®k “k “ki®k-i “k-1 “k-i> p<=k-i “k-1 “k-ii^ ’ 

nmq 



P'^kl^k =k> P<5'kl®i “k-r""'^’ “^yk- 



72 



The resulting integral over in the above expression is 



seen to be a likelihood function since 



./ 



/I i\ / I i <3 k-1, 

P'^kl^k =k> P'^kl^k “k-r" > 



/ I i <3 k-1, 

p'^ki^k “k-i’^ > 



(25) 



Denoting this integral, then, as the likelihood, 

f 

^k'’ = yp'^ki^k p<5'ki^J “k-i-'^ > '^i'k' 



the posterior conditional density (20) is given by (24) 
St (25) as 



V _ / i i I m q , , n m _q i k-1, , iq 

^ ^ \ I ^-1 \-l \-l^P^\-l \-l k-ll^ ^Sc 

i -i k 22H 

,26, P(s, u, a,|z , ^ 

ij nitiq 



This is the desired result for the recursive calculation of 
the probabilities of the states Sj^ Uj^ given the measurement 
sequence z . In terms of the model transition probabilities 
(11) and (12) and the memory function (13) , the transition 
probabilities are computed as: 



, i j il I n m <3 ^ - 

p<=k “k “ki=k-i “k-1 °k-i> = 





u 



m 

k-1 





a 



q 

k-1 



) 
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along the allowable transition paths specified by 



^ ^ / i <5 N 

= *o<^k “k-l> 



For each memory state and control state value at time k-1, 
the transition probability p(u^|u^_j^ '^k-l^ specified 
by (12) for all j,m,q. Then for each j,m,q, the mapping 
probability p(s^|u^ ^k-1 *^k-l^ given for all i by (11); 
the value for is found for each i,q pair by (13) , and 

is computed by (25) . The posterior probabilities are 
then computed by (26) and the state values and their 
probabilities are in place for the next recursion. 

Clearly the ability to carry out the recursion (26) 
exactly depends on whether or not the likelihood (25) can 
be found in closed form. Such a form can indeed be found 
for the linear channel and measurement models (14) and (15) 
in case the noise nj^ is white and gaussian, as will now be 
shown . 

First note that the densities involved in the expression 
for the likelihood (25) are both conditioned on specific 
realizations of Sj, and namely s^^ = and = A^. 

The first density P(Zj^|yj^ s^) is given by (21) for the white 
noise sequence; for the white gaussian sequence, (21) becomes 



(27) P(Z]^1Y]^ sJ) = Pj^(Zj^ - H(sJ)y(k)) = (H (sj) y (k) , R) , 

k 



where N (m,V) is the gaussian density with mean x = m, 

variance V and p (n, ) = N (0,R) . 

^n k n, 

k 
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Consider now the second density in the integrand (25), 
p(yj,ls^ ^) , the Sj^ “ conditional one-step 

prediction density for y^,, along the path specified by the 
S. transition at time k from the memory state A at time 

1 q 

k-l. The path label, then, at time k, resulting from the 
extension of the path labeled A at time k-l, is 

q 



/ I i q k-l. 



^k-i 



, I i q k-l, 

p'^kl^k-l ®k “k-1-'^ > 



I I i q k-l, , 



and since the s^ ^k-1 uniquely embodied in 



k-l . 



36 1 Q j_ 

“^k-l^ ' ^k-1 ^ independent of 

Sj^, the above expression becomes 



( 28 ) p(yj^|aj^;z^“^) = 



'k-l 



,1 i q k-l, 

p'^kl^k-l ®k “k-1'-^ > 



p'yk-ll°k-l'^"’^> "^^k-l 



for each along a path given by 



4 ‘ ^o<4'4-i>- 



Now when the a-conditional density for the initial 
value of yj^ is gaussian and the Sj^ ‘^k-1 ~ conditional 
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channel model is linear gaussian , the above density (28) is 
gaussian for all k, and the mean and variance of the density 
is given by the Kalman filter recursions. 

Specifically, this density is given by 

(29) p(yja^ | k-1 «,) , CA^) ) 

where 



yk|k-l<^l> = ''o' yk-llk-l'^q' 



V, 



1 I, t(Ao) = $(S. A ) V. T I, , (A ) (S. A ) + Q, (S. A ) 

k Ik-1 I - 1 g' k-1 k-1 g' ^ ' i g' '^k ' i g 



h = "o' 



and the recursions for Yj^ | ^k | k ^ ^ given by 

the remaining Kalman filter equations: 



''klk*''t* '^klk-l*''j.* l^k"“*®l'''k|k-l *''n' I 



\lk<^' = (I-Gk(At)H(Si)) V^^.^(Aj) 



=k<''A> = ''k|k-l<''t'H"(Si'tH<Si)\|k-l<''l'»^'Si' ^ ‘V'"' 



Substituting these expressions (27) and (29) back into 
(25), the integral to evaluate becomes: 
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N 









The evaluation of this integral is a basic exercise in 
integration of gaussian densities and is given by [8] : 



(29) = c 



k-1 ^ 



1/2 



' k k-1 



^^k Ik-1 ^ ^ 



where 



Zk - H<Si> ykIk-ilAj) 

+ "Sc- 

B. IMPLEMENTATION STRUCTURE OF ESTIMATOR 

The structure of the filter realization density (26) , 
together with the likelihood calculation (29) , is that of a 
tree with nodes given by the past state trajectories and 
with branches labeled by the states of process. For each 
transition, i.e., each path extension to a new node, the 
likelihood of the transition is computed from the Kalman 
filter recursions along that particular path. The likeli- 
hoods are multiplied by the transition probability for that 
path extension, and by the previous path probability. The 



^klk-l^^S,^ 



^z , = 

^k|k-l ^ 
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updated path probabilities are then obtained by normalizing 
these products. The tree structure showing the evolution 
of the path labels according to a particular function is 
illustrated in Figure 10. 

The next stage of this structure would obviously 
contain N x nodes where N is the number of possible 
states and is the number of nodes at stage k. Thus 
the number of nodes expands exponentially. However, in 
case the function f^ depends only on a finite portion of 
the past trajectory, then the tree structure eventually 
becomes a finite trellis at the stage which accounts for 
the definition of f^, resulting in a trellis appropriate 
for Viterbi decoding. If the function f^ has infinite 
memory, then obviously some approximation technique must 
be used to keep the number of nodes finite. One such 
possible approximation is to save only a given number of 
nodes at each stage, most likely those with the highest 
posterior probability. Another scheme which is possible 
is to save only enough nodes at each stage, the sum of 
whose posterior probabilities is less than or equal to 
some specified number, This latter method is attrac- 

tive from the standpoint that for high signal-to-noise 
ratios the number of nodes saved would be small, while for 
low SNR, the number saved would be larger. This scheme 
therefore would have the attractive feature that the 
processing load would automatically adapt to the SNR. 
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FIGURE 10. Estimator Structure 
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C. ESTIMATOR ALGORITHM 



The following algorithm implements the estimator given 
by equations (26) and (29) . For a practically realizable 
estimator, some rule which saves only a finite number of 
paths as discussed above must be used at step 8. 

Step 0 Initialization: 
k = 0 

1° = MN (number of joint states) 

A°(i), i = 1,2,...,I°, arbitrarily specified 
P°(i) = l/fIN, i = 1,2,...,I° 



Step 1 Obtain indices for new nodes ; 

a) k = k + 1 

b) For q = 1,2, .. . I 

m = 1,2,... M 

n = 1,2,... N 

j = (q-1) I + (m-l)M + n 

Step 2 Label each new node: 

For each n, m, q, obtain 

A^(j) = f^(S^,A^‘^(q)) 
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step 3 Obtain transition probabilities: 



Step 4 



For each n, m, q, obtain 

PTR(m, n, q) = PS(S lu ,U , • PR (U, I U 

^ m'nqq 'k'q'q 

Calculate L for each hypothesized transition 
mq " ^ 

(some obvious indices are omitted) : 

For each n, m, q, compute: 
a) Kalman step: 

=k<3> ' \|k-l'j>«’''V""k|k-y ^ 

^k|k-l^^^ " ^k " ^^^m^ ^k|k-l^^^ 

/\ /V 

yk|k<3) = yk|k-i<’> ^ °k<3)"k|k-i<3> 

''klk'i* = <^-\<3>«<V''k|k-l'^> 
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step 8 Update number of paths 



I 



(k) ^ 



NMI 



(k-1) 



go to step 1. 



It is to be noted that the computations cannot be 
carried out "in place"; that is, A (j) cannot be stored in 

k— 1 

the same locations as A (j) until all the A (j) have been 
computed. Similarly, the Kalman filter means and variances 
must be stored in separate temporary locations until step 5 
is completed. 

D. DISCUSSION AND RELATION TO PREVIOUS RESULTS 

In the language of the literature on non-linear filtering, 
the present result represents an extension of previous 
results in system identification problems to the case 
where the unknown discrete system parameter s^, is the result 
of a probabilistic mapping of an underlying memory-conditional 
Markov process. Previous investigations have treated both 
the case where Sj, is a Markov process [10] , [11] , and the 
case for Sj^ an unknown time-invariant parameter [9]. The 
present result reduces to these results for the appropriate 
modeling of s^,. 

Case I: Markovian Parameters [10] [11] 

In this case, S, is a finite-state discrete- 
time Markov chain with transition matrix 
(P..(k)} = {Pr[s, = S.|s, , = S.]}. The n-dimensional , 

S-conditional system dynamics are given by: 
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and the m-dimensional measurements are 



z 



k 



H(S^)yk + 



The random variables n^^ are zero-mean independent 

gauss ian, and independent of the Markov chain Sj^. 

In terms of the generalized model developed above, the 

memory function f^ (13) is specified, for this case, by 

T 

= (Sj^ ^k-1 * * * ^o^ output state mapping 

probabilities (11) are independent of the (J^, - process 
and given by (p^j(k)}. The system dynamics and measure- 
ment equations, in terms of the realization of the - 
process are then given by 



^k = ^<=k “k-i^k-i '■<=k “k-i’^k 



= H(s, 



:-l^^} 



+ n. 



The posterior measurement-conditional path probabilities 
are given exactly by equation (26) . The likelihood equations 
(29) for L. are obtained in the same manner by replacing 
H(Sj^) with H(S^ Ag) where is a path specification obtained 
through the memory function: A^ = ... ] . 

The posterior probability for the parameter Sj^, then is given 
by summing over the paths : 



83 



P^(S^) = Pr[Sj^ = S^] = 



M 

E 

q=l 



iq 



where 



- Pr [s, = S . ; a, = A |z^]. 
iq k 1 k q 



The CME or MAP estimate may then be obtained 



N 

CME: s, = E s. P (S.) 

k . , 1 1 

1=1 



k k 

MAP; s, = S.: P (S.) = max P (S.) 

k 3 '3 ^ ' 1 ^ 



Case II: Unknown Time-invariant Parameters [9] 

For this case, since the parameter s^^ does 
not change, the memory function is given by a, = s , with 



an initial probability given by p^ = Pr[s^ = S^] , i = 1 , 2 , 
The dynamics and measurement equations are 



. N. 



Yi, = 






w. 



k -1 



2 , = 



^k 



+ n 



k* 



Again the posterior path probabilities for 
s^ are given by equation (26) . The likelihoods are determined 
from equation (29) , but since there is no path branching, 
the Kalman filters all operate in parallel, each on a 
different conditioning S^. 
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Additionally, since the parameter transition probabili- 
ties (k ^ 1) are given by Pr[Sj^ = = S^] = 6j^(i-j), 

the sum over the previous paths, nmq, in equation (26) 
becomes a single term for each path extension, and (26) 
reduces to 



P (S^) = 



I p’'-hs,)L 

j=l ^ ^ 



i = 1,2 . . . N 



which is Lainiotis' result [9]. Note that since there is 
no branching of the paths , the exact optimum solution for 
this case is realizable. 
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VI. A PRACTICAL HKM MODEL 



While the results of the preceding theoretical develop- 
ment show how optimum estimation of the state of the HKM 
process may be performed, it remains, of course, to specify 
the parameters of the model. In this section, specific 
values for the model parameters are derived and it is shown 
in principle how increasingly complex models may be obtained. 
While the specific model derived in this section is one which 
considers the letters of the text to be independent and 
equally likely, it is shown in principle how this model may 
be easily extended to include contextual message information 
as well. 

The parameters to be determined are given by equations 

(9) : 




that is, the state probability transition matrix and the 
recursive memory function. These expressions are given 
in terms of the components of Sj^, u^^, by equations 9a 
and 9b : 

Keystate transition matrix: p(Xj,|aj^ u^^ ®k-l °^k-l^ 



86 



Morse symbol transition matrix: 




Text Letter transition matrix: 




Control transition matrix 



P^\l’^k-1 “‘k-l ^k-1 ^k-1 



Keystate memory function: 




Morse Encoder memory function: 




TEXT memory function 




k' k-1 



Thus the problem is to determine reasonable values 
for the probability assignments (9a) and to construct the 
recursive functions (9b) which account for the portion of 
the process which can be described deterministically. 

A. KEYSTATE MODEL 

The simplest usable model of the evolution of the keystate 
would be the simple Markov model described by: 



This model suppresses any dependence of the transition 
probability on current and past Morse symbols 
and speed of transmission (Uj^) , and limits the dependence 
on past history of the keystate to the immediate past, 
Such a model would have the memory function: 
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V 




B 



k 



f 

a 




^k-1^ 



X 



k 



The four Markov transition probabilities Pr [Xj^=l| , 

Pr [Xj^=l I Xj^_^=0] , Pr [Xj^=0| Xj^_^=0] , Pr [Xj^=0| Xj^_j^=l] can be 
obtained empirically by determining the relative frequency 
of the states 11, 10, 00, 01 in a large ensemble of actual 
hand-keyed Morse messages. Clearly these probabilities 
are dependent on the sampling rate. As a simple example, 
consider the possible realization of an HKM sequence as 
illustrated in Figure 11, with the resulting transition 
probabilities for this sequence given in Table VIII. 



1 11 « « 1 1 n 




' \ \ t n 1 1 r 1 i » « > t » » » M 




i \ rrr- 




i i 1 1 i i r 




1 1 * • 





Figure 11. Example Of Sampled HKM Process 



TABLE VIII 

Transition Probabilities For Illustrative HKM Process 



State 

Transition 

1/1 

1/0 

0/0 

0/1 



No. of 
Occurrences 

30 

3 

16 

3 



Relative 

Frequency 

30/33 

3/33 

16/19 

3/19 



Probability 

Estimate 

.91 

.09 

.84 

.16 
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If the sample rate were different from that illustrated 
then obviously the relative frequency of each of the 
transitions would be different; this dependence on sample 
rate is shown in Table IX. 

TABLE IX 

Transition Probability As Function Of Sample Rate 



Sanple Rate 






State 


Transitions 




(relative to 


illustration) 


1/1 


1/0 


0/0 


0/1 




Freq Prob 


Freq 


Prob 


Freq Prob 


Freq Prob 


IX 


30/33 .91 


3/33 


.09 


16/19 .84 


3/19 .16 


.5X 


13/16 .81 


3/16 


.19 


7/10 .7 


3/10 .3 


2X 


63/66 . 95 


3/66 


.05 


35/38 .92 


3/38 .08 



This artificially induced dependence of the keystate 
transition probability on sample rate is undesirable from a 
modeling viewpoint since, in reality, the continuous-time 
HKM process generated by the sending operator has no such 
dependence, and it is intuitively unsatisfactory to require 
the statistics of the sending operator to fit an arbitrarily 
selected time scale. 

This dependence can be removed by normalizing the time- 
scale to the element-duration, whereby instead of measuring 
the sample rate in samples per second, the sample rate is 
measured in samples per duration in elements. Consider, 
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then, the following expressions for describing the keystate 
evolution : 



p(x |u, B 



k'^k ^k-1 






X. 



k 





where it is seen that the recursion for (fi, counts the mamber 



of samples since the last zero-one or one-zero keystate 
transition. This description then conditions the keystate 
transition probabilities not only on the immediate past 
keystate also on the data rate Uj^, and the number 

of samples, 4)^^, that the key has been in a 1 or 0 state 
since the last transition. 

Now if (J)j^ is given in samples with a sampling interval 
T, then is the amount of time (in seconds) since 

the last 0 to 1 or 1 to 0 transition. If is given in 
terms of words-per-minute , then the element duration for 
this rate is r^ = (6/5) x (1/uj^) . Thus the normalized time 
for this data rate is given by; 




“k ^ 

6 
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This description of the keystate transition probabilities 
is clearly more satisfying since it depends only on the 
individual sending operator's rate of transmission and keying 
characteristics, and not on the sample rate. 

The model is still not complete, however, since it does 
not allow for dependence on the type of Morse symbol being 
keyed, clearly for dots and element spaces, transitions 
between mark and space states occur more frequently than 
for dashes, character spaces, word spaces, and pauses. 
Additionally, these transition probabilities depend to some 
extent on the previously keyed symbols, with the degree of 
dependence being a function of the type of key used. For 
mechanical bugs, a series of dots separated by element 
spaces is sent by simply holding the paddle in one position, 
creating a string of symbols with virtually equal durations. 
When sending a dot/dash combination, however, the element 
space duration is determined by the operator's dexterity and 
not by a mechanical device, so the variability of this ele- 
ment space duration is higher than that for the repeated dot 
sequence. A similar effect occurs when the key is an elec- 
tronic bug, although the variability of repeated symbols 
is even less than that for the mechanical bug. The same 
type of dependence on past symbols has been noted even for 
senders using a telegraph key [12] [13] . It has been found 

that the primary effect is that of reduced variability of 
element-space durations when the preceeding symbol was a 
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dot (a detailed analysis of the effect of key type on 
keystate statistics may be found in [13] ) . 

While the keystate transition probabilities have been 
noted to be dependent on the preceeding symbol sequence, 
this dependence is clearly a second-order effect when con- 
ditioned on the current symbol. In the model developed 
here, then, these second-order effects are ignored and the 
final expressions for the keystate transition probability 
model are given by: 



p(x^|a,^ “k ®k-l’ = 









+ 1 . 



In terms of the normalized time scaled, the transition 
probabilities are /Sj^=A^,rj^,Tj^_^] . For 

example, the probability Pr [Xj^=l lxj^_j^=l,aj^=dot,rj^=rj^,Tj^_^=t] 
is the probability that at time k, the key will remain in 
state 1, given that the operator is sending a dot, that his 
average element duration is r^, and that they key has been 
in state 1 for t element durations. Clearly if t is close 
to zero, then this probability is nearly 1; and similarly 
if t > 2, then the probability is small. 

An equivalent expression of this probability is the 
probability that the duration becomes duration 
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'^k "^k-l "^/^k \ = 1/ then t(^^ = z 4 >j^_ 3 _ + t = 

+ T. This probability can be determined from the den- 
sity of symbol durations, conditioned on speed rj^ and symbol 
type. 

The modeling of the symbol duration densities has been 
a topic of considerable interest among investigators working 
on the Morse decoding problem. In the past, because of lack 
of sufficient empirical data, these densities have been 
assumed to be truncated gaussian or uniform [2] [14]. A 
recent intensive modeling investigation by Technology Services 
Corporation [13] , did indeed demonstrate the not surprising 
result that when normalized for speed variation, the density 
of each symbol duration, averaged over several operators, 
approaches the gaussian density. For individual operators, 
however, the densities are far from gaussian, and no single 
normalizing technique was found which would allow for para- 
metric estimation of the individual densities. Thus, the 
problem of parameterizing the symbol duration densities of 
individual Morse operators remains open. Indeed, the evidence 
supported by the data accumulated so far indicates that 
estimation of these highly individualistic densities must be 
accomplished on-line using a combination of parametric and 
non-parametric techniques . 

It is not the purpose of the present research to delve, 
yet again, into this density estimation problem, but to show, 
whatever, the proper density, how it can be used most effec- 
tively for Morse transcription. For the purposes of the HKM 
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I 






model developed here, then, a parametric symbol duration 
density is hypothesized and justified on the basis of intui- 
tive arguments. Traditionally, the local speed of the Morse 
signal in wpm is defined as 1.2 times the reciprocal of the 
element duration (in sec) , averaged over 10-20 mark-space 
pairs. A histogram of the normalized symbol duration (actual 
duration in seconds divided by average element duration) is 
then taken to be an estimate of the shape of the density 
function for that symbol. The new approach to be considered 
here is to hypothesize an instantaneous speed of transmission, 
defined to be the speed at which a single symbol is sent. 

The instantaneous element duration (baud) is likewise defined 
on an individual symbol basis. The effect produced by 
assigning appropriate probability densities to each results 
in the same description for an average 10-20 mark-space pair 
segment as does the traditional approach. The reason for 
hypothesizing such parameters is simply because it is more 
intuitively satisfying to propose the existence of individual 
symbol statistics whose average behavior duplicates the 
observed empirical behavior, rather than to propose that 
the statistics of each individual symbol are identical to 
the observed average statistics. Although this distinction 
is a fine point, it allows greater flexibility in estimating 
the keystate transition probability with fewer parameters . 

Consider then the following hypothesized random 
variables : 
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r = instantaneous speed of transmission 



A = instantantous element duration (baud) 

and let dot and element-spaces have duration = A; dashes 
and character spaces = 3A; word-space = 7A; pause = 14A. 
Then in terms of the actual symbol duration, d^: 

A = — 
m ' 

where m = 1, 3, 7, 14 as appropriate. 

The normalized symbol duration, in terms of A and r is 
given by : 



♦a = <!' 

Note that while A is well-defined in terms of a measurable 
quantity, r is arbitrary. However, it is convenient to 
define r such that its value is indicative of the actual 
speed: 



= C— ^ i. 

^mean '5^ A 

Although this expression determines the statistical behavior 

of r through its dependence on the random variable A, 

mean ^ ^ 

clearly it does not restrict the freedom to assign appropriate 
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statistical description to the other moments of the random 
variable r, independent of the statistics of A. 

Consider now the random variable (|i^, and note that m<{).^ 
is the normalized symbol duration (in elements) , given that 
the symbol was transmitted at rate r. A density for mcj)^, 
conditioned on r, then describes the keystate duration 
random variable, normalized for speed. Let this random 
variable be described by the Laplacian density (double-sided 
exponential) with mode m and parameter a, as illustrated in 
Figure 12, below. 




Figure 12. Laplacian Duration Densities 
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In terms of the speed r: 




ce 



a (5/6 mAr - m) 



m(j)^ _< m 



p(m(j)^/r) 



a (m - 5/6 mAr) , 

Cj 6 / 



m(j)^ ^ m 



The parameter a and coefficient c are to be chosen such that 
Pr[l(j5^ i 2] = Pr[3(l)^ £ ~ .0135; that is, the probability 

of error in sending a dot for a dash or an element space 
for a character space (and vice versa) is arbitrarily 
selected to be 1.35%. This symbol error rate was found to 
be the average error using optimum separation thresholds for 
55 samples of hand-keyed Morse studied in the TSC analysis 
[13] ; and since the densities are conditioned on the instan- 
taneous speed, the normalized optimum threshold is halfway 
between m = 1 and m = 3. On this basis, then, a and c are 
determined as follows: 



oo 




2 00 




d 



2 



c/a e 



Likewise : 
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Pr[3(})^ ^2] = c/a e 

The probability density requirement gives the other 
equation needed: 

00 

p(m(})^/r) d(|)^ = 1 

— oo 

00 

1 a((}).-l) r a(l-cj).) 

ce ^ d(j)^ + ce ^ d(j>^ = 1 

1 

_ 00 

I 

c/a + c/a = 1 

c = a/2 

Solving for a, c gives, for dots, dashes, element spaces, 
character spaces: 





a = 3.61 

c = 1.81 



Using the same procedure for word space (m=7) and pause 
(m=14) , the values for the densities are: 



word spaces : 


a = 1.81, 


c = .90 


pause : 


a = . 90 , 


c = .45 
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Having constructed the duration densities, the speed- 
conditioned keystate transition probabilities can now be 
determined. 

Let be the current normalized keystate duration, 
i.e., the amount of time (in terms of instantaneous element 
duration) since the last 0 to 1 or 1 to 0 transition. Then 
the required probabilities are Pr[<j)^ ^ ^'^^k-1'^k'^k'’^A — ^o^ ' 

where e is the normalized sampling interval given by 
£ = t/A. It is seen that this expression gives the transition 
probabilities in terms of the probability of extending dura- 
tion for one more sample interval. The conditioning 
parameters provide the normalization coefficients to be used 
for p(m(})^/r). Given the appropriately scaled density then. 



but e > 0, so and the joint probability becomes; 













Pr[<}). > D +e] 
A — O 



and so the conditional probability is given by: 



Prl'fA i V^/'t’A i 



Pr[(})^ > D^+e] 






where ^ computed as follows: 
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00 



u D +e n a 

O 



, -a (D +£-m) 
1_ o 



; D +e > m 
o — 






, a(D +e-m) 
1- o 



; D +£ < m 
o — 



Similarly : 



PrI+a > D^l = J p(*^) 

o 



T -a(D -m) 
1_ o 



'• °o i ” 



1 — -ye 
2 



, a (D -m) 
1 _ o 



D < m 
o — 



Forming the quotient of these probabilities in the appro- 
priate ranges gives : 



Pr[4>. > D +e/<i). > D ] = 

— o A — o 



-ae 



, a(D -f£-m) 

1 - ° 

^ Ir 

^ -a(D^-m) 



, D > m 
o — 



D < m 
o — 



D -)-£ > m 
o — 



1-^ 



T a(D -H£-m) 



1 - 



, a(D -m) 
1-. o 



, D -»-£ < m 
o — 
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The above expression then represents the keystate transition 
probability for the "transitions” 1-1 and 0-0, conditional 
on the current symbol type, data rate, and length of time 
already in state 1 or 0. The probabilities for the transi- 
tions 1-0 and 0-1 are found, obviously, by subtracting from 
1 . 

B. SPEED TRANSITION MODEL 

The random control vector u^^ may contain components 
which model operator sending peculiarities such as random 
insertions of extra dots, slurs, character splitting, or 
any other feature of interest which controls the manner in 
which encoding takes place; it is not limited to speed con- 
trol alone. However, the peculiarities mentioned above 
are highly individualistic and little modeling of these 
peculiarities has been done. It is conjectured that such 
modeling will have the same fate as that of attempting to 
obtain a general parametric model of the keystate duration 
densities; that is, no general model will be found, and 
such modeling will require on-line estimation techniques. 

For the purposes of the HKM model developed here, these 
peculiarities are ignored, and the only component of the 
control vector u^^ considered is the instantaneous speed r. 

The speed transition probabilities are developed on 
an intuitive basis seasoned with experience and the results 
of the TSC study on observed hand-sent code speed variability. 
In that study it was found that, on the average, hand-sent 
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code exhibits a speed difference of about 2.5 wpm between 
segments of 10 mark-space pairs, but that it is not uncommon 
to observe a speed difference of 8-10 wpm between segments. 

Now observing that the speed transition probability expression 
of the HKM model, P ^k-1 ^k-1^ ' allows for 

conditioning on the entire past history of the state of the 
HKM process, it can be seen that this transition probability 
may take into account such items as message duration (for 
modeling the effect of operator fatigue) , the actual text 
itself (for modeling the effect of speed changes due to 
sending different types of text material) , or any other 
feature which may have an effect on sending speed. The only 
conditioning to be considered here, however, is the immediate 
past speed the past history of the encoded output, 

and the keystate duration Let 

£ {i; 10 ^ i ^ 60, i an integer}; that is, a set of 
discrete speeds in wpm between 10 and 60 wpm. The following 
model for P ^ proposed: 

If 0 (no change in keystate) , then 

P<“klVi “k-i = "il“k-i ' *'j'“k-i'®k-i ^ 

( 0, if i 7^ j . 



1 , if i = j . 
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That iS/ the speed is not allowed to change except when the 
keystate changes from 0 to 1 or 1 to 0, no matter what the 
previous symbol is. For = 0, the speed transition 

probabilities are made conditional on the type of Morse 
symbol just completed; 

For ^ indicates dot, dash, e-sp: 

Pr[u^ = R. ± 2i,|u^ = ' Pjl <“k-l> 

where i = 0 , 1 , 2 . 

This assignment of tansition probabilities allows the 
speed to change by increments of 0, ±2, ±4 wpm according 
to the probability Pj • 

For indicates c-sp, then the increment remains 

the same, but the transition probability assignments may 
be different. 

For indicates word-sp, the increment is increased 

to 5, and for ^ indicates pause, the increment is 10. 

To complete the model, the Pj remain to be selected. 

These probabilities, which were selected on the basis of 
speed differences reported by TSC (and on intuitive appeal) , 
are given in Table X. 

Note that the absolute average speed differences for 
the four categories correspond roughly to the ranges observed 
by TSC. 
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TABLE X 



Symbol-Conditional Speed Transition Probabilities 



Syiibol Just Speed Increment/Probability Average 

Conpleted (wpm) Increment (v?pn) 



dot, dash, e-sp 


-4 


-2 


0 


2 


4 


1.6 




.1 


.2 


.4 


.2 


.1 




c-sp 


-4 


-2 


0 


2 


4 


2.0 




.15 


.2 


.3 


.2 


.15 




w-sp 


-10 


-5 


0 


5 


10 


4.0 




.1 


.2 


.4 


.2 


.1 




pause 


-20 


-10 


0 


10 


20 


10.0 




.15 


.2 


.3 


.2 


.15 





C. MORSE SYMBOL TRANSITION MODEL 

The symbol transition probabilities, conditional on the 
letter being sent, are obviously either zero or 1, since 
knowing the letter specifies the code sequence. If the 
model is only a first or second-order Markov model, then the 
symbol transition probabilities for various types of text 
may be computed. Since it is desired to test the performance 
of the estimator as a function of modeling complexity, these 
probabilities were estimated for both a first and second 
order model and are given in Tables XI and XII, respectively. 
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TABLE XI 



First-Order Markov Symbol Transition Matrix 





• 


— 


/N 


V 


W 


P _ 


• 


“ 0 


0 


.58 


. 33 


.07 


.02 


- 


0 


0 


.54 


.37 


.07 


.02 


/N 


. 55 


. 45 


0 


0 


0 


0 


Or 


. 5 


. 5 


0 


0 


0 


0 


W 


. 5 


. 5 


0 


0 


0 


0 


P 


.5 


. 5 


0 


0 


0 


0 



TABLE XII 

Second-Order Markov Symbol Transition Matrix 





. 




/N 




w 


P . 


• /N 


.55 


.45 


0 


0 


0 


0 


• Or 


.5 


.45 


0 


0 


0 


0 


. w 


.5 


.5 


0 


0 


0 


0 


• p 


. 5 


.5 


0 


0 


0 


0 


/N 


. 55 


.5 


0 


0 


0 


0 


-O; 


. 5 


.45 


0 


0 


0 


0 


-w 


. 5 


.5 


0 


0 


0 


0 


-P 


.5 


.5 


0 


0 


0 


0 




0 


. 5 


. 581 


. 335 


.069 


.015 


/N • 


0 


0 


.54 


.376 


.069 


.015 


O/* 


0 


0 


. 923 


.062 


. 012 


. 003 




0 


0 


. 923 


. 062 


.012 


.003 


W. 


0 


0 


. 923 


. 062 


.012 


.003 


w- 


0 


0 


.923 


.062 


.012 


.003 


P- 


0 


0 


.95 


.04 


.009 


.001 


P- 


0 


0 


.95 


.04 


. 009 


.001 
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The encoder memory function, may be constructed to 

record the previous symbol for the first-order model, or 
the previous two symbols in the second-order case. In case 
the symbol transition probability is made conditional on 
the letter being sent, there is no need to record previous 
symbols for use by the encoder. As a minimum, however, the 
function f^ must record the previous symbol for use by the 
speed transition probability, since it has been made 
conditional on this symbol. 

D. TEXT LETTER TRANSITION MODEL 

For equally likely independent letters, the letter 
transition probabilities are uniform, and the only con- 
ditioning necessary is on so that when indicates 

the end of a letter, the letter transition is allowed to 
occur. During the period when does not contain a 

c-sp, w-sp, or pause, obviously the letter transition 
probability is zero. This case of equally likely letters 
is the highest complexity modeling actually coded and tested 
in this investigation. It is clear from the theoretical 
error-rate analysis of section III, however, that the 
largest payoff in terms of increase performance is to be 
found in more sophisticated models for this transition 
probability and memory function. This fact was recognized 
early by Gold [12] in his study of the Morse decoding problem, 
in which he developed the MAUDE algorithm for decoding of 
the demodulated Morse waveform: "The conclusion is inescapable. 
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therefore, that for the automatic reception of a language 
encoded by even a simple process like Morse code, a machine 
must have some knowledge of the language if it is to 
approximate the performance of a man." 

The major difficulty, however, in modeling the message 
text is that the type of text is not constant. The letter 
dependencies are highly variable among such traffic types 
as call-up, response, chatter, formatted messages, plain 
language messages, code groups, etc. Here again, then, 
it is conjectured that the only real solution is to perform 
on-line modeling of this transition probability and memory 
function. Clearly a straightforward application of proba- 
bility estimation techniques, while feasible, is simply 
not practical in this case. For a third-order model, the 

4 

storage requirements would be on order of 36 = 1,679,616 

words, just to store the transition probability matrix. 

The f^ function would require 36^ locations to keep track 
of the three prior letters. Although some reduction in 
memory could be accomplished since some letter combination 
rarely occur, it is evident that the storage requirement 
is large. The most promising technique for utilizing the 
decrease in source entropy may be one similar to that for 
recognition of speech using a linguistic statistical decoder 
[15] , with appropriately modeled linguistic elements and 
using an appropriate channel model [16] . If a suitably 
flexible grammar for a set of Morse messages can be defined 
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then perhaps a form of syntactic decoding is in order [17] . 
If the semantics of the message are well-understood then 
one possible approach is to use a dictionary look-up to 
form the f^ function, on a word basis. This technique for 
English text messages is under investigation by an ARPA- 
funded MIT project, but a final report of the results has 
not yet been issued. The Army Research and Development 
Agency is currently studying the possibility of defining a 
grammar for a specified set of Morse messages for use in 
syntactic decoding. These kinds of techniques for dynamic 
on-line construction of the function and estimation of 
the transition probabilities are clearly the only realistic 
methods of reducing the entropy of the text sufficiently 
to obtain error rates comparable to that of the human 
operator, in any situation except for random letter groups. 



108 



VII. A PRACTICAL HKM CHANNEL MODEL 



The general baseband HKM channel model developed in 
Section jv is given by the channel and observation 
equations (10) : 



Yu = 






^k-1 ^ 



^ ^®k ‘^k-1^ 



w. 



z, == 



H(s^) 



+ n. 



where Zj^ is the sampled output of the detector. The specific 
model to be considered here requires the parameter y and 
functions F, F, H, to be selected such that the resulting 
model has the following features : 

(1) The noise process represented by n^^ is a zero-mean 
white gaussian process, with known variance 

(2) The amplitude y^^ is observed only when = 1, 
that is, during the signal on-time (MARK) , so 
that H(Sj^) = H(Xj^) = Xj^. 

(3) During a MARK, the fading amplitude process obeys 
a linear gauss Markov process given by: 



^k = Y ^k-1 



+ V, 



where the parameter y and the variance of are 
selected to represent the fading observed at the 
detector output. 
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( 4 ) 



The observed effective transmitted amplitude is a 
random variable which obeys the following time- 
varying linear gauss-Markov process: 



^k ®k-i>yk-i + ’■'='k ^k 6k-i>’'k 



where F and F are selected such that: 

(a) During a MARK the transmitted amplitude 
remains constant. 

(b) During a space the amplitude can change, the 
amount of change being dependent on the type 
and duration of the space. 

(5) It is assumed that the detected signal has been 

gain- leveled by an AGC, so that the average detected 
output power is normalized. 

The parameter selection and function construction process 
for each of these features is discussed below. 

A. THE OBSERVED NOISE PROCESS 

Since the noise process observed at the output of the 
detector is the result of envelope detection of a narrowband 
gaussian process, the resulting process is neither zero-mean, 
gaussian, nor white. The sampled process, however, has 
independent noise values if the sample interval t satisfies 
T > 1/2 where B„„„ is the bandwidth (in Hz) of the 

band-pass filter preceding the envelope detector, provided 
that also the bandwidth of the low-pass filter of the envelope 



110 



detector is greater than 28^^^. If x is less than this 
value, then the sampled noise is correlated, and a model 
which accounts for this correlation would theoretically 
provide for better estimation. Several techniques are 
available for such modeling, [18 ] and should be used if 
the noise is correlated. Clearly if x is selected purely 
on this basis alone, then the assumption on independence 
can be satisfied. There may be, however, other competing 
constraints on the selection of x, and although the value 
selected may render the independent noise assumption invalid, 
its effect can be minimized by selecting it as large as 
possible within the other constraints. 

The bandwidth of the bandpass filter is selected on the 
basis of the largest signal bandwidth expected. The highest 
code-speed under consideration for this processor design 
was selected to be 50 wpm, which has a minimum pulse duration 
(MARK) of 24 msec. The specific filter implementation was 
selected to be a cascade of two single-tuned resonators , 
since this combination has a respectable ratio of noise- 
bandwidth to 3-dB bandwidth of 1.22 [19], and can be coded 
with relatively few multiplication per sample. For this 
filter implementation the optimum bandwidth as given by 
Skolnik [19] is .613/. 024 = 25 Hz, and has only .56 dB 
of loss in SNR compared to the matched filter. Although 
such a narrow bandwidth greatly increases the SNR of a 
signal in a 4 kHz receiver bandwidth and effectively eliminates 
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most interferers, it is clearly too narrow to accept signals 
which have a significant carrier instability due to chirp 
or drift. Since it is not uncommon to observe carriers 
with a chirp on the order of 50 or so Hz, the bandwidth 
required is on the order of 100 Hz. There is obviously a 
strong motivation, therefore, to investigate filtering 
techniques which would adapt to the chirp, since a 100 Hz 
wide filter represents a loss of 6 dB compared to the 
optimum bandwidth of 25 Hz. Motivation for adaptive 
filtering techniques is also provided by the fact that at 
20 wpm the optimum bandwidth is only .613/. 060 = 10 Hz, 
thus there is a 10 dB loss in SNR compared to the optimum 
bandwidth when using a 100 Hz filter. 

For this investigation, since the primary emphasis is 
on optimum demodulation and decoding techniques, a fixed 
100 Hz band-pass filter is used. For this bandwidth, then, 
the sample rate may be selected to be 200 Hz, with a resulting 
sample interval of 5 msec. Since this quantization is con- 
sidered adequate for representing the minimum duration 24 msec- 
long pulse of the 50 wpm code with sufficient precision, 
then T is selected to be 5 msec. , resulting in independent 
noise samples. 

Since approximately 5 msec, is the largest quantization 
allowable for adequate precision in representation of the 
code symbols, and since adaptive techniques for the band- 
pass filter would result in narrower bandwidths, the assumption 
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on independent noise samples would be violated for this 
case, requiring a model which accounts for correlated 
noise, if optimum techniques are to be pursued. 

Although the zero-mean assumption on the output noise 
process is violated, a zero-mean process may be approximated 
by estimation of the mean and subtraction of it from the 
detected output. Estimation of this mean value also pro- 
vides an estimate of the noise variance, R^, which has been 
assumed to be a known value throughout. (Again, although 
techniques are available for modeling in the case of unknown 
noise intensity, the simplified approach taken here is to 
use the estimate of R, as if it were the true value. It can 



be seen in section IX, Table XIII, that the resulting pro- 



within a rather large range of the true value.) Estimation 
of the mean noise level relies on the following relationships. 



density N^, input to the BPF; let be the output of the 
envelope detector, with ^ ®BPF illustrated below; 



•k 




Let X^ be a white gaussian random process with one-sided 



X 




2 



BPF 



( ) 



B 



LPF 



Figure 13. Envelope Detection Process 
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Then, from Davenport [20l , 



A 





n 



R 



A 



Var (Z^) 




2 



n 



Thus if y can be estimated in the absence of a MARK, then 
n 



Implementation of such an estimator is described in 
Section VIII. 

The assumption of a gaussian process for n^ is clearly 
violated since the output of the detector has a Rayleigh 
density in the absence of a MARK, and a Rician density when 
signal is present. Thus not only are the statistics not 
gaussian, but also they are correlated with the signal when 
a MARK is present. By choosing to ignore the higher-order 
moments of the density (greater than 2) , the resulting 
estimator based on this assumption may not be optimal in 
the sense of providing as good a conditional-mean estimate 
as possible, but it will still provide the minimum-mean-squared- 
error estimate. 



R 



n 




and the approximation to a zero-mean process is - y^. 
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B. THE MEASUREMENT FUNCTION 



During the period when = 0 , the transmitter is 
turned off and it is not possible to observe the amplitude 
which is being used to transmit the MARKS. Thus only 
noise is observed during this period, and by ignoring 
the correlation between signal and noise when signal is 
present, the measurement equation is simply: 

‘ "k 



C . FADING MODEL 

The effect of fading can be observed during a MARK 
period, with the maximum fade rate being determined by the 
band-pass f ilter/dectector bandwidth, under worst-case HF 
channel conditions (rapid, intense fading) . For typical 
values of fading rate on the order of 1 Hz, the fading 
parameter y, for a 5 msec sampling interval is given by: 

^ ^ g-(. 005) (27t) (1) ^ 

The intensity observed at the output of the gain-controlled 

detector can be approximated for the typical 1 Hz fade rate 

by noting that during a 1 sec fade period the amplitude 

can change by about 3 dB for a typical receiver AGC circuit. 

The intensity for this range of change, i.e., the variance 

of V. is about: 
k 
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Var (Vj^) = [2/(1. /. 005) = [2/200]^ = .0001, 

As discussed earlier, in Section IV. B, when no signal 
is present, the effect of fading is that the subsequent MARK 
appears at an amplitude which differs from the amplitude 
of the previous MARK in such a way that it appears as if 
the MARKS of the signal were transmitted at a random 
amplitude. Because of this effect, these mark-to-mark 
variations are lumped together with the variations caused 
by an actual change in transmitted power. 

D. APPARENT TRANSMITTER POWER VARIATIONS 

In addition to the Mark-to-Mark amplitude variations 
discussed above, the actual transmitted power may vary. 

Usually this effect is most prominent when working with a 
communications net, since the received power of each of the 
transmitters on the net will usually be different. These 
changes usually occur after a pause (during which one net 
member has signed off and another is preparing to sign on) ; 
however, , it is not uncommon for a new net member to sign 
on during a time duration for a word space or even a character 
space, especially if net discipline is good. It is assumed 
that changes do not occur during an element-space or a mark. 
The following model accounts for these effects: 

a) For a. - mark: 
k-1 

= Var(Vj^) = . 0001 
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“k-1 ®k-l> = ^ ' •” 



b) For ->- element space; Xj^ = 0 : 



Q = 0. 
w 



YF(*) = 1. 



c) For element space; Xj^ = 1 



Q = .01 

w 



YF(‘) = 1. 



d) For ^ any other space; x^^ = 0 



Q =0, 
w 



YFC) = .98 



e) For ->■ any other space; x^, = 1 



Qw = -25 



YF ( • ) = 1. 
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Part (a) is just the fading model for Marks discussed 
above. Part (b) expresses the statement that no change in 
amplitude may occur during an element space. Part (c) 
states that, at the end of an element space the transmitted 
amplitude has not changed, but a variance of .01 is asso- 
ciated with the amplitude observed on this transition. The 
value .01 is obtained by considering that at the end of an 
element space transmitted at 50 wpm, the fade may have 

4 

decreased the amplitude to (.97) = .89 of its previous 

2 ~ 

value, thus a variance of (1 - .89) = .01 is appropriate. 

Part (d) states that for any other space, while the variance 
associated with the transmitted amplitude is zero, the 
amplitude is assumed to decrease exponentially with time 
at the rate (.98); and Part (e) allows a subsequent MARK 
to appear with amplitude determined by a gaussian random 
variable of variance .25. (The construction of the F(*) 
function is implied by the assignment of variances to the 
various Q . ) 
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VIII. IMPLEMENTATION OF HKM STATE ESTIMATION ALGORITHM 



The implementation of the estimator algorithm (Eqn. 26, 

30) for the signal and channel models just described is now 
presented. In the context of this model, estimation of the 
keystate is referred to as demodulation , estimation of the 
Morse symbol is termed decoding , and estimation of the text 
letter is called translation . The estimation algorithm 
performs joint demodulation, decoding and translation, i.e., 
these estimates are not made in a serial fashion; rather 
the structure of the code is used in an optimal way to aid 
in demodulation, and the structure of the text is used to 
aid in decoding. From this viewpoint the algorithm repre- 
sents a "correlator-estimator" [21] technique in which a 
sequence of all possible keystate transitions are hypothe- 
sized and correlated with the incoming signal, and the most 
likely sequence is output as the best estimate. From the 
viewpoint of coding theory, the algorithm represents a 
tree decoder in which all possible paths of the joint state 
evolution of the process are examined and extended in an 
optimal way. If the memory function were dependent on only 
a finite portion of the past history of the process (usually 
a good approximation) then the tree decoder reduces to the 
Viterbi decoder. As implemented herein, the decoder is 
moat like the M-Path algorithm described by Haccoun _[22] , with 
the path metric being the product of the likelihood of the 
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received signal along the path and the transition proba- 
bility for the path extension. If the decoder is constrained 
to save only one path, then the decision-directed optimal 
linear filter investigated in [2] is obtained. 

Proceeding now to a detailed description, the algorithm 
is presented in terms of the Fortran code used to implement 
it. Subroutine PROCES is the main calling routine which 
takes an input signal sample each 5 msec, along with an 
estimate of the noise power, and calls the appropriate rou- 
tines in order. The first routine called for each sample 
point is TRPROB, which computes, for each previously saved 
path ending at node J, the probability of extending the 
path to new nodes which are labeled to indicate the joint 
state (keystate, element state, letter state, data rate). 

These probabilities are computed using the model and equa- 
tions described in the previous section. Next, subroutine 
PATH labels the new path extended to each new node with : 

(1) the number of samples since the previous keystate 
transition along that path; (2) the data rate of the new 
node; (3) the identity of the element state at the new 
node; (4) the identity of the letter state at the new node. 
These labels are obtained from the memory function f^ with 
arguments provided by the identity of the path being extended 
and the identity of the new node to which the path is being 
extended. Subroutine LIKHD is then called to compute the 
likelihood of the input signal sample for each transition 
under the hypothesis that that particular transition occurred. 
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LIKHD maintains an array of Kalman filters for computing 
this likelihood as given in Section V.A by equation (30) , 
and using the specific channel model described in the previous 
section. 

Having obtained the new path identities, transition 
probabilities, and likelihoods, the posterior probability 
of each new node {i.e., each path extension) is computed 
using equation (26), in subroutine PROBP. Next, routine 
SPROB computes the posterior probability of each keystate 
(0,1) and each element state, and the conditional mean 
estimates of the data rate, by summing over the appropriate 
nodes. The MAP estimate of the keystate at this point is 
the demodulated signal, and the conditional mean estimate 
of the keystate is the (non-linear) filtered version of 
the detected signal. Also the evolution of the MAP esti- 
mator for the element state may be observed at this point, 
and represents the decoded message with zero decoder delay. 

The next function to be accomplished is the saving of 
paths for the next iteration. It is at this point that the 
estimation algorithm becomes sub-optimal, since it is 
clearly not possible to save all paths at each stage of 
iteration. A technique which yields a high probability 
that the correct path will always be saved obviously pro- 
vides the best sub-optimal performance. Several techniques 
for selecting the paths to save are available. The 
simplest idea is to always save a fixed number, say 
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Mj^ax* determined empirically, however, that, while 

this technique does indeed give a high probability of 

saving the correct path, most of the time the posterior 

probabilities of many of the saved paths were very low and 

need not be extended at all. At the instant of a keystate 

transition, however, the probabilities become more uniform 

and it is necessary to save all the M paths. The next 

max 

technique then was to save only enough paths such that the 
total probability saved was equal to subject to the 

constraint that M is not exceeded. Another technique 
suggested by [22] is to make the number of paths saved a 
function of the probability of the highest probability path, 
such that when the highest probability path has a very high 
probability, fewer paths are saved. Either of the last 
two techniques has the attractive feature that the decoding 
computational burden is adaptive to the signal-to-noise 
ratio and the data rate, and the first of these was selected 
for use, with the additional constraint that at least one 
path for each element state is always saved. This algorithm 
is coded in subroutine SAVEP. 

Also in subroutine SAVEP, the saved paths and their 
identities are renumbered in order of decreasing probability 
and a pointer array is maintained to identify the previous 
node from which the saved path was extended. Additionally, 
the parameters of the Kalman filters are reindexed to be 
consistent with the new path indices. After action by 
SAVEP, then, the arrays are ready for the next iteration. 
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Before proceeding to the next iteration, however, the 
trellis of saved paths is updated with the new saved nodes 
and connected to the proper previously saved paths by using 
the pointer array. Decoding and translation are accom- 
plished within subroutine TRELIS by operating on the trellis 
of saved paths. Decoding is done by finding the one node, 
at sufficient delay, from which all successor paths origin- 
ate. If no such single node exists within the trellis for 
a maximum delay of 200 samples (1 second delay) then decoding 
is obtained by reading the node at delay 200 which is 
connected to the current highest probability path, and 
all other paths not originating from this node are deleted 
from the trellis. Since the text has been modeled by a 
source of equiprobable , independent letters, translation 
is done by a simple mapping of the decoded Morse symbols 
into the proper letters and numerals. 

There are three auxiliary processing routines for pre- 
processing of the signal , intended to simulate the operation 
of a receiver, bandpass filter and envelope detector, along 
with the routine to estimate the noise power in the detected 
signal and provide a zero-mean noise process . Subroutine 
RCVR converts the incoming signal at carrier frequency 
to a frequency of 1000 Hz using an 8 kHz sample rate, and 
provides a single-pole 500 Hz BW band-pass filter. Sub- 
routine BPFDET implements the 100 Hz bandwidth band-pass 
filter by a series of two digital resonators centered at 
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1000 Hz, and accomplishes envelope detection. The low pass 
filter of the envelope detector is a 100 Hz bandwidth 3- 
pole Chebyshev filter. Subroutine NOISE estimates the noise 
power present during a space condition by obtaining the 
minimum value of the envelope detected signal over a period 
of 240 samples (1.2 seconds). This minimum value is ob- 
tained at each 5-msec sample point and averaged. The 
average is then scaled, with the scale parameter selected 
empirically, to provide the estimate of y^, the mean value 
of the envelope detected output during a space. This esti- 
mate is subtracted from the envelope detector output to 
provide an approximation to a zero-mean noise process; RN, 
the estimate of noise power in the detected output is then 

/V 2 

given by 2y^ . 
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IX. SIMULATION RESULTS 



The Fortran coded algorithm just described has been 
programmed on a PDP-10 time sharing system, along with a 
signal simulation routine to generate a Morse code message, 
a routine to simulate transmitter effects, and a channel 
model routine. The text generation routine selects letters 
and numerals either at random or from a pre-defined text 
file. The corresponding Morse code sequences are generated 
by a table look-up, and the durations of each element are 
randomized according to a selectable probability law. (For 
the results presented here, the probability law used was a 
truncated gaussian such that no element is ever less than 
16 msec or greater than 360 msec in duration. The variance 
was selected to give the error crossover probabilities on 
an element basis to correspond to the good, fair, and poor 
operator defined in section III.B.) The waveform generated 
by this process is used to modulate a carrier of frequency 
0 )^ £ 4 KHZ, which is simulated by discrete-time process 
sampled at 8 kHz. This carrier is then subjected to the 
fading model (VII. C) and white gaussian noise of selectable 
power is added. This received carrier is then input to 
the receiver, bandpass filter and detection routines dis- 
cussed previously. The output of the envelope detector, 
adjusted in level by subroutine NOISE, is then input to the 
main processing algorithm, PROCESS; the demodulated, decoded 



and translated results are presented on a CRT from which 
hard copies may be obtained. 

The overall objective of the simulation experiment is 
to determine how well the finite-path suboptimal estimator 
performs relative to the optimal estimator. Since it is 
not possible to code the exact optimal estimator due to 
exponentially expanding memory and computation, the lower 
bounds an error rate derived in Section III are used as a 
basis for comparison. Secondly the performance of the tree 
decoder (the term tree decoder will be used to refer to the 
suboptimal finite-path estimator) relative to other simpler 
techniques is to be evaluated. Finally the performance of 
the tree decoder as a near-optimal demodulator for Morse- 
code is to be obtained and compared to the performance of 
the linear matched filter with integration time equal to 
the basic element duration. 

A. THE IDEALIZED KA24 TREE DECODER 

The idealization assumptions made in Section III for 
deriving the lower bounds on error rate can be obtained by 
constraining the estimation algorithm to have path branching 
only at the possible transition times of a synchronous KAM 
signal, and by making the input a true baseband Morse wave- 
form with added white gaussian noise and no fading. This 
experiment was run in order to determine the validity of 
the lower bounds derived there and to obtain a data base 
for evaluating the sensitivity of the tree decoder to 
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non-ideal conditions. The results of this experiment are 
shown in Figure 14 for the three cases of first-order and 
second-order symbols and independent letters. Clearly 
under these ideal conditions the lower bound is very nearly 
obtainable. 

Also shown for comparison are the results of demodulation 
accomplished by linear matched filtering with decoding 
accomplished by thresholding the durations at 2T, where T 
is the basic element duration. These results show that the 
demodulation provided by the tree decoder is clearly superior 
to the matched filter, and that the independent letter 
model is of sufficient complexity to obtain near-optimal 
demodulation. 

Next, the effect of lack of synchronization was obtained 
by removing the branching constraint on the paths , but 
still keeping the same idealized input signal. The results 
are shown in Figure 15. By comparing with the results for 
the synchronous case, it is obvious that at the lower SNR's 
the performance is degraded. 

The next effect to be investigated was the sensitivity 
to noise statistics in the estimator's lack of knowledge 
of the true noise power. These results, shown in Table XIII, 
indicate that the estimator is relatively insensitive to 
incorrect estimates of noise power within a reasonable 
range . 
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TABLE XIII 



NOISE POWER EST SENSITIVITY 
(20 wpm KAM) 



SNR Est Used by Decoder (dB) 
9 6 3 2 1 



TRUE % LTR Error 

SNR (dB) 

(100 Hz) 

0 
1 
5 




2 



19 - 14 14 



B. THE REALISTIC HKM TREE DECODER 

Although the results discussed above are of theoretical 
interest since they demonstrate a high degree of correla- 
tion with theory, they have little practical value in 
determining the performance of the demodulator and decoder 
functions under more realistic signal conditions. The 
first series of tests used a KAM signal as input, in order 
to correspond the results to those above for the idealized 
case and to obtain a basis for comparison with the HKM 
case. Table XIV shows the performance of the tree decoder 
as a function of the decoder constraint length (decode delay) 
and as a function of the degree of optimality of the 
estimator. (The degree of optimality is given by the 



130 



TABLE XIV 



Performance of First-Order Markov Decoder vs. Decode 
Delay and Degree Of Estimator Optimality - 50 wpm KAM 



Decode Delay (Samples) 



Degree of 
Optimality 



<%t> 



SNR 

(100 Hz) 
dB 



Avg . No . 

of Paths 0 40 200 

Saved % Error % Error % Error 



.98 



12 

9 

6 



20 

20 

20 



0 

9 

68 



0 

5 

45 



0 

5 

45 



. 95 



12 17 



0 0 0 



9 

6 



17 9 5 5 

18 68 45 45 



. 9 



12 

9 

6 



14 

15 
15 



0 

12 

56 



0 

8 

52 



0 

5 

46 



12 

. 85 9 

6 



12 


3 


3 


2 


12 


32 


32 


29 


12 


58 


56 


53 



.8 



12 


8 


3 


3 


2 


9 


8 


38 


39 


36 


6 


8 


68 


67 


63 



parameter P^^^/ discussed above, where only enough paths 
are saved such that the sum of the computed posterior path 



probabilities ^ P^p^.) These results show that the 90- 
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optimal estimator with a decode delay of 200 (1 second) 
is very nearly as good the 98% optimal decoder. These 
values were selected, then, for the remaining tests. Table 
XV shows the performance of the tree decoder as a function 
of model complexity, and the improvement in performance 
with increasing complexity at the lower SNR's is evident. 
For comparison the results for the independent letter model 
are plotted in Figure 16 along with the results for the 
idealized case, and the lower bound for envelope detection. 



TABLE XV 

PERFORMANCE OF DECODER vs. MODEL 
COMPLEXITY - 90% OPTIMAL ESTIMATOR, KAM SIGNAL 



DECODER MODEL 







First 


Second 


Indep 


Avg no . 


Speed 


SNR (dB) 


Order 


Order 


Char 


of paths 


(wpm) 


(100 Hz) 


% Error 


% Error 


% Error 


Saved 




12 


0 


0 


0 


14 


50 


9 


5 


4 


3 


15 




8 


14 


11 


5 


15 




7 


36 


30 


16 


16 




6 


46 


41 


35 


16 




9 


0 


0 


0 


8 


20 


6 


10 


6 


3 


8 




4 


12 


9 


6 


9 




3 


43 


38 


31 


9 



132 
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The next series of tests used a simulated hand-keyed 
signal as input at nominal speeds of 20 and 30 wpm. The 
performance for the good, fair, and poor keying character- 
istics (element error probabilities of .00143, .0149, and 
.0403 respectively) was evaluated for = *9/ and decode 

delay = 200 as a function of model complexity. These 
results are tabulated in Table XVI. The result for the 
fair sender is shown in Figure 17 along with the corres- 
ponding result for the KAM signal and the theoretical 
lower bound. 



TABLE XVI 

Decoder Performance For Simulated Hand-Keyed Morse 







30 wpm 




20 wpm 




Sending 


SNR (dB) 


% Letter 


Avg No of 


% Letter 


Avg 


Quality 


(100 Hz) 


Error 


Paths Saved 


Error 


Paths 




9 


3 


8 


1 


9 


Good 


6 


5 


8 


4 


10 


(Sending 


4 


36 


9 


6 


10 


Error Rate 
= 1%) 


3 


- 


9 


31 


11 




9 


5 


9 


4 


10 


Fair 


6 


7 


10 


6 


10 


(Sending 


4 


42 


10 


8 


11 


Error Rate 
= 10%) 


3 


- 


11 


34 


11 




9 


12 


11 


11 


12 


Poor 


6 


13 


11 


13 


13 


(Sending 


4 


46 


12 


14 


13 


Error Rate 

o e* o _ \ 


3 


— 


12 


38 


14 



*6 
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The adaptability of the decoder to abrupt changes in 
speed of transmission was next evaluated at several values 
of SNR. This test was run by causing an abrupt speed 
change to occur after every tenth letter. The output was 
then compared to the output for the no speed change case 
to obtain the extra errors introduced by the speed change. 
This increase in error caused by speed change is tabulated 
in Table XVII, as a function of the magnitude of speed 
change and SNR. A KAM signal was used for the 50 wpm speed, 
and a fair sending operator was simulated for the 30 and 
20 wpm signals. 



TABLE XVII 



Decoder Speed Adaptability 



Speed of 

SNR Previous Segment 



50 

9 dB 30 

20 



% Error Increase Over 
Constant Speed 

New Speed 

50 30 20 

- 1 2 

0-1 
1 .0 



50 

8 dB 30 

20 



2 4 

1-2 

11 - 



50 

6 dB 30 

20 



-56 
4-4 
4 3 - 
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In order to compare the decoder performance with the 
performance of the MAUDE algorithm and Howe's quasi-Bayes 
decoder [14] , the decoder was next tested against simu- 
lated hand-keyed signals using the same mark/space durations 
that were used in Howe's tests. The simulated signals 
consisted of the following keying characteristics : 

51 - Moderate variance handkeyed: Mark-space sequence 

with nominal 1-3-7 mean element duration ratios and element 
standard deviation- to-mean ratio of 0.2, nominal sending 
speed of 15 wpm. average sending letter-error 

rate = 10%) . 

52 - Abrupt speed changes, low variance handkeyed: 

Mark-space sequence with nominal 1-3-7 element duration 

ratios and element standard deviation to mean ratios of 

0.15 with abrupt nominal speed changes among 10, 15, 20 

wpm rates. (E , each speed segment, = 3%). 
s 

53 - Gradual speed change, low variance manual: Same 

as S2 above, but with gradual speed changes between 
approximately 10 and 20 wpm over a period of 30 seconds. 

Each of these files was used to modulate a carrier of 
constant amplitude to which white gaussian noise was added 
for signal-to-noise ratios of 12 dB, 9 dB, 6 dB referenced 
to 100 Hz. The results of this test are shown in Table 
XVIII. A comparison of these results for the high SNR 
case (the only case considered by Howe) with the perfoirmance 
of the quasi-Bayes and MAUDE algorithms is shown in Table 
XIX. 
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TABLE XVIII 



DECODER PERFORMANCE FOR SIMULATED HAND-KEYED 
MORSE USING HOV7E ' S MARK-SPACE FILES 



File 


12 


SNR (dB) 
9 


6 




% Error 


% Error 


% Error 


SI 


11 


11 


24 


S2 


4 


6 


11 


S3 


5 


6 


13 



TABLE XIX 

COMPARISON OF TREE DECODER WITH MAUDE AND 
HOWE'S QUASI-BAYES DECODER, HIGH SNR 



File 




Decoder Algorithm 






Tree 


MAUDE* 


Quasi-Bayes* 




% Error 


% Error 


% Error 


SI 


11 


20 


8 


S2 


4 


12 


5 


S3 


5 


14 


6 



* Data for MAUDES Quasi-Bayes From [14, p. 74]. 
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C. STATISTICAL SIGNIFICANCE OF EXPERIMENTAL RESULTS 



The sample size used in each of the experiments des- 
cribed was approximately 200 letters. Since the sample 
size is greater than 30, and since each experiment was 
performed under well-controlled conditions, the outcome 
of each experiment (proportion of letter errors) may be 
reasonably assumed to be a sample point arising from a 
gaussian density. Under this assumption, the following 
90% confidence intervals [23] are applicable (Table XX). 



TABLE XX 



90%-CONFIDENCE INTERVAL FOR EXPERIMENTAL RESULTS 



MEASURED EXPERIMENTAL 
ERROR RATE 



90% CONFIDENCE 
INTERVAL 



5% 



3%- 8% 



10 % 



7%-14 



15% 



11%-19% 



20 % 



15%-26 



25 



20%-31 



Q, 



30 



24%-36% 
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While the relatively small sample size of 200 letters is 
adequate for the well-controlled simulation experiments, 
because of the consistency of the input signals, a much 
larger sample size would be required for testing against 
actual data. Because of the lengthy processing time 
required on the PDP-10 implementation (one minute of data 
requires approximately 20 minutes of processing time) , 
however, it was not feasible to obtain large quantities 
of test data against actual signals. The following field 
results given in Tables XXI and XXII, therefore should be 
considered a proof of feasibility of the tree-decoder, but 
not necessarily typical of results to be expected under a 
wide range of signal and keying characteristics. 
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X. PRELIMINARY RESULTS FROM FIELD DATA 



In order to obtain an estimate of the projected 
performance of the tree decoder under actual signal and 
channel conditions, the algorithm was tested against several 
tape recordings of signals made in the field. Analog tape 
recordings of the output of a receiver using a 4 kHz IF 
band width with fast-attack, moderate-speed decay (approx. 
200 msec) AGO were made. These tapes were digitized using 
a sample rate of 8 kHz. Each cut is approximately 50 
seconds in duration, resulting in a relatively small, but 
significant, data base for analysis. The text in each case 
was context-free, and all signals were of sufficiently high 
signal-to-noise ratio so that the true transmitted text 
could be recovered from the detected output. The results 
of these tests are shown in Tables XXI and XXII 
for the KAM and HKI4 signals respectively. 



TABLE XXI 



PERFORMANCE OF TREE DECODER AGAINST 





ACTUAL 


SIGNALS, KAM SENDER 




Sample 


Data Rate 


Avg SNR (dB) 


Letter 




(wpm) 


(100 Hz) 


(%) 


1 


35 


20 


1% 


2 


30 


16 


2% 


3 


28 


16 


1% 


4 


32 


18 


10% 


5 


30 


20 


8% 
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TABLE XXII 



PERFORMANCE OF TREE DECODER AGAINST 
ACTUAL SIGNALS, HKM SENDER 



Sample 


Data Rate 
(wpm) 


Avg SNR (dB) 
(100 Hz) 


Letter 

(% 


1 


18 


20 


4 


2 


16 


16 


3 


3 


22 


18 


15 


4 


20 


20 


8 



The disappointing results for samples 4 and 5 of the 
KAM signals are attributed to two effects observed on these 
cuts. Sample 4 contains several long sequences of high- 
level "static" or "burst" noise, which appear in the 
envelope-detected output as energy which is inseparable 
from true marks of the desired signal. Although these 
false marks are of lower level than the actual signal, 
the algorithm assumes that they are faded marks of the 
incoming signal and demodulates them as such. Although 
the algorithm successfully rejects many of the shorter 
spurious marks because they are inconsistent with the 
speed of transmission, enough are accepted as valid marks 
to cause the error rate to be high. 

In the case of sample 5, all of the errors are attributed 
to a low level Morse interferer which becomes predominant 
when the desired signal is in a word space or pause condition. 
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During these times, the receiver gain is not controlled 
by the relatively high-level desired signal, and the under- 
lying interferer is of sufficient SNR (approx. 8 dB) to 
be demodulated by the tree decoder algorithm. 

For the HKM cuts, the comparatively high error rates 
for samples 3 and 4 are attributed to the same type of 
interf erence/AGC effect discussed above, although in sample 
3 the interferer is one leg of an FSK teletype signal. For 
all the HKM cuts, the sending quality is rated as good-to-f air . 
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XI. SUMMARY AND CONCLUSIONS 



The extinction of communication by Morse telegraphy 
has been repeatedly predicted aperiodically since about 
1950. While the commercial use of this mode of communica- 
tions is virtually nonexistent in the U.S., except for some 
maritime services, it is still used in the military services 
of many countries. The reliability of Morse links is 
well-known and long-distance communication, particularly at 
HF, is possible under conditions of interference and atmos- 
pherics which would render other means of communication 
useless. The simplicity, reliability, and efficiency of 
the receiver (the human mind) preclude extinction of this 
oldest form of successful electrical communications. 

Radio communication between two persons using Morse 
code is a distinctly human process, involving nuances of 
code variations and tacitly assumed conventions between 
the communicators, which make machine transcription of 
the human-sent code particularly difficult. The theoretical 
development of a unified structure for modeling a Morse 
message (not just the code itself) presented in this report 
shows how the various aspects of linguistic context, 
formatting, individualistic operator sending peculiarities, 
and code symbol dependencies may be combined in the design 
of an optimal Morse translator. As a practical example of 
modeling of the Morse message within this structure, a 
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model for independent equally-likely letter messages was 
derived, and the resulting decoder was tested against a 
variety of simulated and actual Morse messages. 

The results of the simulations show that the error 
rate of the idealized KAM decoder [Fig. 14,15] approaches 
the theoretical lower bound for the gaussian channel, 
derived from coding theory arguments , and that the increase 
in performance compared to a linear dot-matched filter can 
be significant at low signal-to-noise ratios. Secondly, 
the performance of the HKM decoder using envelope detection 
[Fig. 16] was demonstrated to be only moderately sensitive 
to the non-gaussian nature of the noise statistics at the 
output of the envelope detector, for SNR's above approxi- 
mately 4 dB in 100 Hz. Finally the performance of the HKM 
tree decoder against simulated hand-keyed Morse [Fig. 17] 
shows that, under these laboratory conditions, the tree 
decoder can be expected to provide an error rate no worse 
than that of a human transcriber for; (1) output copy with 
an acceptable error of 10% or less; (2) independent equally- 
likely letter messages. In comparison with the MAUDE 
algorithm, [Table xix] the tree decoder shows a significant 
decrease in error rate on the simulated data, while in 
comparison with Howe's Quasi-Bayes decoder the error rates 
are about the same. 

These results show that for the case of random letter 
text, the performance of a human operator can be very nearly 
obtained by optimal non-linear processing techniques. The 
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estimation algorithm derived in this investigation is 
adaptive to speed changes, varying noise levels and fading 
signals and has performed for approximately 90 hours of 
running time (approximately 21,000 characters total) without 
exhibiting any noticable signs of divergence or instability. 
The computational burden is severe, however, and for prac- 
tical use would require possibly a pipe-lined approach 
with digital hardware under microprocessor control. 

The strength of the tree decoder for random letters 
lies primarily in its use of the Morse code structure to 
perform channel decoding, i.e., demodulation, and secon- 
darily in its use of the structure to accomplish source 
decoding. For contextual messages, however, a well- 
constructed model of the linguistics, semantics, ad format 
embodied in the structure of an appropriate f^ text function, 
describing the evolution of the message states as a finite 
state machine, would add significantly to the error-correction 
capability of the decoder. To the extent that such a function 
can accurately describe the Morse message linguistically, 
the error-rate for contextual messages may be made to 
approach that for the human operator. As such, the parallel 
between the problems of Morse translation and automatic 
speech understanding is evident and therein lies the rub, 
and perhaps, the solution. 
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APPENDIX 



SAMPLES OF OUTPUT DATA 

I. In order to obtain an intuitive appeal for the errors 
produced by the tree decoder, several examples of 
output copy are shown below for various levels of 
keying quality and signal-to-noise ratios. Errors 
are indicated by an underline. 

A. 50 wpm, KAM, 12 dB SNR: 

A LAZY BROWN DOG JUMPED OVER 2 LOGS 
ON A SUNNY SUNDAY AFTERNOON 

B. 20 wpm, Fair Key, 9 dB SNR: 

A LAZY BROWN DOG JU_^ED OVF 2 LOGS 
ON I SUNNY SUNDAY AMTERNOON 

C. 20 wpm. Fair Key, 6 dB SNR: 

A L§2 BORWN DO^ JUMPED JHF 2 LOGS 
ON A SUNNY SUDDAS AFDRNOON 

D. 20 wpm. Fair Key, 6 dB SNR (same as C. , but with 
a different noise sequence) : 

A LSZY BROWN DOZ JUMPED OVEL 2 LOGS 
ON A SUNNY lUTSANO AFTEGNOON 
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E. 20 wpm. Fair Key, 4 dB SNR 



V LAZX HROWN D UD JUMPED JVEL IMI 
L_OGS ON A SUNNY IM6ACN AFORNOON 

F. 15 wpm, KAM, 12 dB SNR 

CWA6 DE LAB I AW THE QUICK GREY FOX 
JUMPED OVER THE LAZY BROWN DOG ON A 
SUNNY SUMMER AFTERNOON. THIS IS A 
TEST. WV JVXI JGBA GBEY IQNH 
OPRP CIPU URUC RHIC MUJX SKYQ 

G. 15 wpm. Fair Key, 12 dB SNR 

CWA6 DE HHH lAW THE QUICK GREY FOX 
JUMPL OVER THE LAZY BROWN NRO GON 
^UNNY SUMMER AFTERNOON. ^IS IS A 
NSCK WV JVXI JGBA GBEY IHIH 
OPRP CIPU UKUC RMIC MUJX SKYQ 

H. 15 wpm. Fair Key, 6 dB SNR 

C^A6 DE 5HH lAW ^E QUICO GREY FOX 
JUMPED OHER T^ LAZY B^OW5_ NROG QN 
i^UNNY SUMMER AFTERNOON ^IS A 
NSCK VW JVXI JGBA GBE 3SHIH OPRAS 
CIPU SKUC RHIC MUJX SKYQ 
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II. The waveforms shown in the following Figures (Fig. 

18) are provided to give a visual appeal to the quality 
of the signals processed by the tree decoder. In 
each figure the input Morse keying signal is on line 
a. Immediately underneath, on line b is the output of 
the envelope detector after the carrier has been 
modulated by the keying signal, additive noise applied, 
filtered and finally detected. On line c is the 
detected signal, after downsampling to 200 Hz and 
adjusted in level by subroutine NOISE. The output of 
the zero-delay MAP estimate of the key state (the 
demodulated signal) is on line d. These waveforms are 
the result of processing message E. above. Note that 
although the demodulated output in many cases is not 
correct, the correct letter is still decoded, because 
of the soft decisions utilized in the tree-decoder. 
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FIGURE 18a. Output Waveforms 



Input Signal 
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FIGURE 18b. Output Waveforms 
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FIGURE 18c. Output Waveforms 
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FIGURE 18d. Output Waveforms 
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FIGURE 18e. Output .Waveforms 
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FIGURE 18f. Output Waveforms 
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FIGURE 18g. Output Waveforms 
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FIGURE 18h. Output Waveforms 
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FIGURE 18i. Output Waveforms 
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COMPUTER PROGRAMS 



3330 

3330 

3400 

3500 

3600 

3700 

3rt00 

3900 

1000 I 

H30 

1200 

;300 

1400 

1500 

1600 

i700 

1300 

l900 

>300 

>103 

>300 3 

>300 ' 

>400 

>530 

>600 2 

J700 
> 8 '00 
>‘^00 
5000 
5100 



I^TtiGEf? ELVm 4 T»XHaT 

DIMENSION SI (512), Sa (512), S3 (512) 

DIMfc*JS!OM S4(512) 

DmTa RN!/. 1/ 

PATa NP/(3/ 

CALL INITl 
call InPUTL 

O') 2 .^1 = 1,51 a 

00 3 N2=l,12 

CALL SriSGl (X, ZSIG) 

CALL WCVR(7SIG,ZRCV) 

CALL oPFHETCZRCv.Z'OtT) 

MPsNjP + 1 

TF(r>P.LT.40) GO TC 3 

W P s p 

CALL n01Sc(ZCET,RN,Z) 

CALL PR0CFS(7.,RN,XHAT,PX,FLf'1WAT,LTRHAT) 
CO'UlNUt 



K, s I 

CALL STaTG(ZDET,Z ,PX , XH A T , S 1 , S2 , S3 , S4 , N) 
CQLTlNUe 

CAUL OISPLA CSl ,Sa,S3,S^) 

GJ TO 1 

STOP 

EnO 
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00 1 £’(3 
00?30 
0 5330 
03^30 

0 0 5 0 0 
03^«0'3 
00/93 
003(39 
03930 
01030 
01109 
01293 
01390 
01400 
31‘500 

0l6ii0 

01 /00 
: 01 990 
01900 
02009 
021 )"> 
02290 
0230 3 
02400 
025iJ!3 
0263'^ 
02700 
029?3 
02990 
■03390 
03139 
0323'0 
03339 
03430 
03509 
33630 
037313 
03900 
03933 

04030 
041 39 
042-10 
04330 
044 33 
04530 
04630 
04 7 93 
04339 

049.30 

■05003 
05 1 33 
05299 
'^5333 

^0540 9 

i 055 1 ■/I 

0 5 6 vj ’3 
,05703 
'05930 
,05933 

I 

L 



SU9WQuTiN£ IMPUTI 
dimension ES5P (6) ,FDfV (6) 
COM3QM/3LKl/TAij/8L,<6/Of‘'EAN,)(DUi0»PSf:P,EOEV 
COmmON/8L^2/WC,^CHIRP, asIGMa,3SIRMA,PHISGM, 

data TAli/ 01331^5 / ,£3ep/i ^ 3^ l.3,7,ia/,£0EV/6*3 
oata xnjp/3,/ 



Type 100 

193 .puPMATCIX.'ImpiJT keying PaRMS: RArE,M£AN ELEM DURATIONS') 
ACCE'^T 200, rate, (tSEP(K),K = i,f,) 

Type 159 

iS ;3 EORhaTUX, 'INPUT eUEM OURATION STD DEVIATIONS') 

ACCEPT (EDEv(K),KsI, 6 ) 

^■90 forma rc?F) 

TYPE 303 

300 FORMAT (1 X ,' I nPUT 3 TG PARMS- A V AR , 8 V A P , FCH I RP , TCH I RP , PH I V AR '^ ) 
ACCEPT 23 ' 9 ,AVAR, 8 VAR,ECHIRP,TCHIPP,PHI\/AR 
type a '9 0 

43^3 1 - OR,'lA r ( 1 X , ' I MPijT STG PARMS; G A MM A , PR E Q , NO I S £ ' ) 

ACCEPT 2 ^ 00 ,GAMMA,FC,RNniSE 



ASlGMAsSORTCAyAR) 
^oTGMasoORT C 8 V AR) 
RiiISGMsSDRT (PHI VAR) 
RSTGMsSUR r CRM0I5E) 

CilEAMziaoj./RATE 

"C=b,283l 9*FC 

NCHipp5b,2d31 M*FCHIRP 



TF(E5£P(1) ,me,3,) gq rO 50M 
FoFPCDzl . 

FScp (21=3. 
c3EP(3) =1. 

ESEP f 43 S3, 

FSEP (59 =7, 
tSEP (63 = 14. 



590 FtTijR.f 
END 



riNt r'lTL 

dimension IELM3T(4'9D) , ILAMl (in) , ILAmx (63 
01 1ENST JM Fi.EMTRn,6,6) , 'R TR AN 3 ( F , ? ) , ISX(6) 
niMEMSIGw >'EMKC’4(':iP0,b) , LTRm Ap (430 ) , IALPH(79) 
D I 1£NS ION ‘-'E'''DEL (6 , - 3 ) , MEMp;? ^ b) , I OLANK {HHZ) 
dimension I array (3) , I text (POP) 

lEL “'ST , ILAMl , ila.mx 
C 0 ■ ' 1 0 N / 8 L 0 A T / M E M (; E |_ 

COM^Cr-./RI.Kr I,m/EeE •»TR/bl.KSpn/RT 9 aNS , MEMPR 
C()'"ii 3 u/BI KMr ISX 

C 0 < G N / 8 L K T P M / L r R '• A P , I A L P H , I 8 L A N K 
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06101^ 
06200 
06300 
06<100 
0630/1 
0b600 
06700 
06300 
06*^00 
0/003 
07103 
07233 
07303 
07’»33 
07533 
0763H 
07739 
07333 
07^30 
083'33 
031 2'3 
08230 
08333 

mm 

08530 
08630 
08700 
03890 
08930 
09030 
39100 
09200 
09300 
09430 
09S^j3 
09600 
097^0 
09890 
09900 
ld330 
1M100 
10230 
13300 
10900 
10500 
10600 
Wm 
12800 
139«'l 
11090 
11130 
11209 
11339 
11430 
11500 
11600 
11703 
Il3>d0 
1P00 
12 '3 00 



2 

2 

?. 

a 

c 

3 



2 



2 

2 

2 

2 

2 



CCJMiiaN/3l.KTXT/TTexT 



data ISX/ 1 , 1 , 0 , 9 , 0 , 0 / 

0a7a M?:MFCM/q, 11, 13, 15, 9, U, 13, 15,9,0,11, 3, 13, 0,15, 9, 
3aa#0 , 

lv-1. 12, la , Ih, 10, 1?, 1 a , 16,0, 1 9, 0, 1P,0, ia,M, 16, 384*0, 

1 , /) , 0 , 0 , 5 , 0 , 0 , 0 , 1 , 5 , 1 , 5 , 1 , 5 , 1 , 5 , 38 4 *0 , 

0,2, 0,0,3, a, 0,3, 2, 8, 2, 6, 2, 6 I?, 6, 334*0, 
0,9,3,0,0,3,7,9,3,7,3,7,3,7,3,7,384*0, 

0 , 0 , 0 , 4 , 0 , 0 , 0 , a , <i , 8 , (4 , a , 4 , 8 , 4 , 8 , 384 *0/ 

OaTa KUi^ST/1,2,3,4,5,6,7,8,9,13,11,12, 

13,14,15, 16,384*0/ 

OaTa 1 1- a mi/3,4, 5, 6, 3, 4, 5, 6, 1,2, 1,2, 1,2, 1,2/ 

CaTa ILAOX/ 1 , 1 , 0 , 9 , 0 , 0 / 



HATa LTR 9 aP/3, 4, 5,6, 3, 4, 5, 6, 1,2, 1,2, 1,2, I, 2, 384*0/ 



0«Ta IAuPH/'a*, »R» 'C 



M ' , ' K ' , 



, 'n», »E», 



F', 'G', *1', 






"o', *X', 'Y*, 'Z*, '1', '2', '3', '4', '5' 



# /. # # 7 # 

f o 9 7 f 



'8' , '9' , '.0' ,0,0, 'AS' , 'SN' , 

0 , 0 , 0 , 3 , ' '12 ' , * f-iO ' , 'G A ' , ' 0'< * , ' AP ' , ' SK ' , 0 , 0 , 0 , 0 , 

' 1 9 I * , 0 , 0 , 0 , 3 , * 0 T ' , 0 , 0 , 0 , ' EF.e ' / 

CAT A I6L A0K/499*0/ 



data ELEMT9/,55, .5, ,5, .5, .55, «5, ,5, .5, 8*0. , 

2 ,45, .5, .5, ,5, .45, .5, .5, .5, 8*0., 

2 8*0. , .581 , ,54, .923, .923, .923, .923, .95, .95, 

2 8*9. , .335, .376, .062, .062, .062, .062, .04, .04, 

2 8*0. , .067, .069, .012, .912, .012, .312, .009, .309, 

2 8*0,, ,0l5, .015, ,003, .003, ,0W3, .003, .301 » .001/ 



data 2T2AN3/,l,,2,,4,.2,,l,.r8,.2,,3,.?,,l5/ 

0 A 7 A MK . IDEL / n , 0 , 2 , 2 , 5 , 1 0 , 0 , 0 , 2 , 2 , 5 , 1 0 , 

2 2 , 2 , 0 , 9 , 3 , 0 , 2 , 2 , 0 , 0 , 0 , 0 , 2 , 2 , 0 , 0 , 0 , 3 , 

2 2,2,0,G,9,V 

DATA mEo«k/?,0, 1,2,1,2,O,0,1,2,1,2,1,1,0,0,0»9, 
2 1 , 1 , 0 , 0 , 0 , 9 , 1 , 5 , 0 , 0 , 0 , 0 , I , 1 , 0 , 0 , 0 , 0/ 



OPEN (U'l IT 520, F U.F.S 'M9P5£M») 

no 10 t=i,390 

«KAn(29,30l (IARPAY(X) ,Ksl ,6) 

39 Fu.9M*TCaiil 

00 U Ksl,6 

1 1 M6:mFC 0 f I , K ) = I APR A Y CX+2J 

LTP^'APC^sI'<PP*TCl7 

RUMSTa)slARRAYr2) 

IF C ( TcL9ST CD .FT. 71 ,nv. (itLr.ST m ,£G,3) ) 
2 RLAviKnisI 

( CRUMST n 1 .FG.al .OR. CIELMST f I ) ,E0.4l 1 
2 CI ) =p 

1? CONTr-i'JE 

F^OFILF ?'j 

OPE.-R U'= r T 5 2 J , F I UF = ' OLIl PUT ' 1 
0 0 50 T = I , 50 0 

R I T E ( 2 , 4 '0 ) ( M £ 'z F C ( I , ^ ) , X s 1 , 6 1 
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122^0 


a0 


FuRMATf. 19X,0 CI3,3X) ) 


12300 


50 


CONTiUUt 


12509 




tNiOFlUF 20 


12690 

12700 




QRcM (UNI rs;?''l, F IL£s 'TF 


12800 




DO 00 Is 1 , 1715 


12*^00 




RtAD(20,7O) ITEXTCI) 


13000 


70 


format (123 


13100 


00 


continue 


13290 




E^QFILE 20 


13300 

13^00 




return 


13500 




END 
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,03.? P! 
i030f5 
laaQ!^ 
050'3 
0600 
0700 
9830 
3900 
1?00 
1100 
1203 
130^ 
19,j0 
1500 
1630 
17 00 
1330 

1900 
20?0 
2100 
2203 
2300 
2'100 
2500 
2600 
2700 
2800 
2900 
3300 
3130 
3200 
•3303 
3^00 
13500 
'3600 
I37Q0 
13800 
'3^00 
■900 3 
'4103 
'42?. 3 
'^3/.0 
a/ij? 
14500 
1 4 6 3 0 
1470!^ 
I4B00 
‘4900 
’5000 
'5100 
5200 
15330 
!S400 
'55.0 0 
'5h?0 
'57 7; 0 
'3R00 
' 5 9 0 " 
I b 0 2 0 



SUB.90uTlfvie STf^SGl (X , SIG) 

CQMHOn/BlK 1 /TAU 

CaMf^DN/atK^/'^iC, l^CHIRP, ASIGMA.PSIGMA, PHISG.'I, 
a'vSir.M, rCHIKP, GAMMA 
Data xlaST/i ,/,B fTA/i ,/ 

'OaTa AMP/1,/,8FaDH/0,/, theta/0./, PH 1/0,/ 

DURsSETa 
Call AtY-(DiR,x) 

fiFTAse5TA*a,-X-yLASr+2.*X’»XLA.5T) + l. 
Tas<*(1,-XLA3T) 

X L A 5 T s X 

CALL RAN‘)4(^i, I , 3. , A8IGMA) 

AMPaAMP+TK*!^ 

IF (AHP.LT, .0 1 J AMPS. Ml 

CALL PAMC.l (>', 1,0,, BSIGHa) 

BF ADLaG ah, < iA^»eF ADe + « 

A iPLJaA.'^P + BPACe 

IF (AiMpP.Ll 8FAOF.a0,0Zl-AMP 

AnPaa AMp+eFAHE 
TnuR3i0.7,3.*TAj*b£TA 
i»/CHKPrX*wCHiPP*EXP(-tOliR/TCHIPP) 

TH'£TAxThF:TA + C '(C + ..4CHPP) *TAiJ 
ThETAsAMOO (,THCTA,6.2a319) 

CALL RAMDNj(t,, I , M ,, PH I SGMj 

PhTsPhI+Tk^w 

P«IaAMO0 (PHI , 0.33319) 



S I G r X « amp ! i * S T .'.( THE T A +PH I ) 

Call RAnON (Z\', 1,0. , RSIGH) 
SIG = SIG + .I‘4 



peiurm 

E N n 

SHRPOUTpE KFy(DIJR,X) 

dimension ESEPCb) ,eDEV(b) , MORSE ( ID » «0) 
niMENSIOM TOUT (530) , TSYM«L(6) , ITEXT(P00) 
CO'N'^UN/-L,-«;cNU/ TEND 

Cf]M,'H?N/aLK 1 / TaU/PL!' 6/0MEAN, X D'JP , ESER , E0£ V 
C U M I '' 0 N / B ' K r X T / t T E X T 
H A T * I ^ / " 0 '? 1 2 0 0 0 M 0 3 0 0 / 

D.iT A L TR/c''V , nE|,m/2 / , N/0 / , nlTR / 1 / 
b A I A n R 5 c / 1 , i » 2 , 3 » 0 » 0 » 0 » 0 » 0 . 0 » 

2 2»3,l,3,l,j3,l,0,2,0,?,3,l,3,l,3,l,0»'0,0> 

2 2 , i , I , 3 , I , -1 , 0 , 0 , 0 , 0 , 1 , 0 , 2 , 0 , 0 , 0 , 0 , , 0 , 0 , 

2 1 , 3 , 1 , 3 , 2 , 3 , 1 , 7 , 0 , .0 , 2 , 3 , P , 3 , 1 , 0 , 0 , vl , M , 0 , 

2 1 , 3 , 1 , 3 , 1 , 3 , ! , X , 3 , , I , 3 , 1 , 0 , n , 0 , 0 , 0 , M , 0 , 

2 1 , 3 , 2 , 3 , 2 , 3 , 2 , ? , 0 , 1 , ? , 3 , 1 , 3 , 2 , 0 , 0 , 2 , 0 , 0 , 

2 1 . 3 , P , 3 . 1 , 5 , I , 0 . 0 , 7 , 2 , 3 , P , 7 , 0 , 0 , ^ , 0 , 0 , 0 , 

2 2 , 3 , 1 , 7, , M , 7 , 0 , 7 , 7 , 2 , 3 , ? , 3 , 2 , y , 0 , 0 , 7 , 0 , 

2 1, 3, ?, 5, ?,X, 1,0, '^.7, 2,3,2, 3, 1,3, 2, 0,7, 7, 
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06101^ 


2 


1 . 3 , 2 , 3 , 1 , 3 , 0 , 0 , 0 , 0 , 1 , 3^13 


06235^ 


2 


2 , -4 , 3 , 3 , 0 , 0 , . 0 , 0 , 0 , 0 , 1 , 3 , 1 , 3 


06300 


2 


1 . 3 , 1 , 3 , 1 , i , 2 , 0 , ? , 0 , 1 , 3 , 2 ^ 3 


0 b'J 00 


2 


2 , 3 , 1 , 3 , 1 , 3 , 2 , 0 , 0 , -0 , 2 , 3 , 1 , 3 


06500 


2 


2»3,2,3, 1,3, 1 , 0 , 0 , 0 , 1 ,3,2,3 


3e60P 


2 


1 ,3, l,3,2,3,2,3,2,r.’,l,3,l,5 


06700 


2 


1.3, 1,3, 1,3, 1,3, 2, 0 , 1 , 3, 1,3 


06300 


2 


2. 3, 1,3, 1,3, 1,3, 1 , 0 , 2 , 3 , 2, 3 


06900 


2 


2, 3, 2, 5, 2, 3, 1,3, 1 , 0 , 2 , 3 , 2 , 3 


07000 


2 


2 . 3, 2 , 3, 2 , 3^2,3,2,0,401X0/ 


07100 

07200 




data ISY-^BL/IK. , 1 H^, Ih , 1 H/ 


07300 




3£T AS r’aa, *taij*dijr 


07400 




IF CB 6 TA.lt, XCUR) GO TO 200 


37500 




(^ 6 LhsNELN+ 1 


07600 




ItLMsMORSe (NfLi^, LTR) 


07700 




TF (IEL'^.F' 6 , 0 ) GO TO 100 


07330 




■iFLNsu 


07900 




Y a R A N ( T ) 


03000 




I6LMS4 


03120 




IFCY.GT.,9) IELN=S 


03200 




IFr(Y.LE,,9),AV0.(Y.GT,.3)) 


083-03 




Y 5 R A N! ( U ) 


08400 




Y = 35* CY-.J^n + l . 


08530 




lY SY 


00600 

03700 




L T R a I Y + 1 


06830 




G-J TO 107 


08930 




'■91,Tk sNI. TRf 1 


090130 




LTRa T TFX T C^^uTR) 


^9100 




IrCirR.tQ.O) 161. ‘-^aa 


09200 




IF Cl.TR,eQ,371 ItLMsS 


0933 3 




IF CUTR.cC, 3d) T£l:-i56 


09-133 




NLTRaf..LTo + i 


095o0 

096/3 




L rRalTExT (M lTR) 


09/qt 


100 


V' a N + 1 


0930.x 




ICu T C.'i) a T 3 Y.'IRL ( lEL.'^) 


09933 




IF Cn.lT .3v’ ^) GO TO 1 10 


10000 




\aC 1 


101-30 




NLTRzo 


10230 




Tc'-iOa 1 


103/0 




I Y f- 6 9 0 0 



I 

1 1063? 
1373a 
13? 30 
; 139-3? 

I U?3'3 
;U33.3 

I U 9 3 a 

I ll53v'" 
Ub3? 

,117j-3 

liis/e 

111933 



90 3 



i 3 00 
iv^ 



I 13 



FC‘9%4T (/, /, IX , *> tMO UF »U'J; INJPUT O&TA WAS;*,/) 
Otl 1? <3 J , 1 3 

K I 5 C K - 1. ) * 5 0 •*< I 
< r* s < * y .1 

uoirz r''-v-, ricuT(L) ,u=K t ,K?) 

format k/ , 1 X , 5 0 A 1 ) 

COM IN' I? 

ACCEPT tpyo, 'A A IT 

X N 5 1 3 c F C T E 1_ 5 , 0 N t A M 

V 5 I G 3 F 0 F V C I F 1. 0 ) * Q,M A N 

Y 5 R A \ ( T lA > 

. MY-.S) 

XCiJPaX‘'i-Y*x 3 tGN 
I F C X . L I , 5-L' , } X O'JR 3 ^ 0 . 

X = 1 . 

TFI IEL nnt. i) Xs^. 
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12100 

12303 



RETURN 

End 



0010P) 
0031^14 
003011 
00400 
00500 
00600 
00700 
008 
00900 
01000 
01103 
01200 
01300 
01400 
01503 
01600 
017;'!0 
01903 
01900 
02000 
0213O 
02230 
02.330 
02400 
02503 
026.20 
02700 
029 30 
02900 
03000 
031 30 
03200 
03300 
03400 
03500 
03600 
03700 
03900 
03930 
04000 
04100 
04200 
04300 

044U0 

04500 
04600 
047.03 
04A.,)0 
04900 
05030 
051 00 
05230 
05300 
05 4 ’')!/) 

05530 
0560 3 



suBRnijir^e displa csi ,S2, S3,S4) 

0I^^£N3I0^^ Sl(bl2),S2(5t23,S3(512),SaC512) 
CALL tRASiI 

CALL PLCTRCai ,512,0, yM,a0'O) 
call PL0TRCS2»5i2,!7I,XM,275) 

CALL PLCTR (S3,512, I , 1 . * 150) 

CmLl pi.OTKtS4,5i2,0,yM,a0) 

CALL VIEOC'l*) 

ACCEPT 1?00,,nAIT 
10C30 FUR-oaTCaS) 
return 

END 



SUBWGUUNE STATSCXTNI, XIN2,XIM3.yi.Na,St , 

?. 52, S3, 34, 

01 PENSION S 1(5 12) ,52(512) ,53(512) ,34(512) 

51 (ri)sXlNi 

52 ( vi) SXIM2 

S3(n) sXl‘J3 

34 Ci\) =X J.N4 

R E T U R 1^' 

END 



SUAROUTlNt AUTOCR (35,RS) 

DIMENSION 55(512) ,R3(512) ,5(1000) ,RSt C500) 
OAT A 3/ 10'O0*D. / , XN/0, / 



X ,N s X V + 1 

CO 100 Isl,5‘'U' 
s (I) =35(1) 

Pol (I) =0. 

100 continue 

DO 200 Isl.S'^U 
00 30 0 Xs 1,500 

R31 (I)sMSl (I)+SCK + T-l)*S(i'0 

i 'A/. C C T I i-i U £ 

200 continue 

00 400 Isi,50K 

RS(I)s(r(5(n*(X;i-l.)+R3l(n)/XN 
400 CONTl\Lt 



R E I U R N 
E.ND 
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001153 
00200 
00300 
00400 
00500 
00600 
00700 
00800 
00900 
01003 
01103 
01200 
01333 
01403 
01500 
01809 
01739 
0lfl29 
01930 
02033 
02109 
02239 
023/50 
02430 
02539 
02833 
02700 
02893 
02909 
03033 
03130 
03230 
03330 
03433 
03539 
038 39 
037?0 
036 33 
03900 
04939 

0'4l39 

04239 

04339 

04439 

04593 

04839 

04793 

04693 

049.3a 

059 0 3 

05139 
0529 9 

05399 

05439 
055 3 9 
05809 
057.39 
05699 
05 403 
089 39 



Su 0.^OUTINE P'7UCESl.Z,WN,)(HAT,PX,ELMHAT,l,ri2hAT9 



C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

r. 

c 

c 

c 

c 






I n t 



This sueRouTr'iF: implements the processing algorithm 
TOR JOINT OEMQDULaTION, OECOOING, AND TRANSLATION OF 
The received morse process, it takes in a new MEASURE- 

"lE^Vf.z.OF The HETECTFO SIGNAL EVERY 5 ^SEC AND PRO- 
DUCES AN estimate of the current KEYST ate * element 
state, AMD letter of the received signal. 



definitions of variable NAMES; 

Z- input sample of detected signal 

RN- input NCTSE PQ'-vER estimate 

Y'iAT- OUTPUT estimate OF KEYSTATE 

ELMHaT- output estimate cf element state 

LTRiiAf- output estimate Of' LETTER STATE 



C 

C loAVE- 40, OF PREVIOUS PaThS SAV£0 

C IPATH- TDENTirY QF SAVED PATH 

C LAM3,)a (I) -UtE.NTlT'r QF LTR STATE OF SAVED PATH I 

G 0‘JR(D- Du«ATIG.\' 0'=' element ON PATH I 

C ILRATE m -IDENTITY QF DATA RATE ON PATH I 

C PIN(I,n)- computed TRANS PR03 FROM PATH I TO STATE N 

C LAi-^SAv (Jl -IJE. nTITY of LTR STATE AT ,NEW NODE J 

C IlRSAV ( J) -TOENT ITY OF DATA RATE AT NEW NODE J 

C LKriD(J)- LIKELIHOOD VALUE FOR NODE J 

C PCJl- COMPUTED POSTERIOR PRQR OF PATH 

C ending AT .NEW MODE J 

C RSELE.M (K) -CC'^PU TEO POSTERIOR PRQB OF £LEM K 

C SPOUAT -COMO .MEAN estimate Qf INSTANT DATA RATE 

C PX- POSTERIOR PROB THaT KEYSTATE EQUALS I 

C 

c The eqllowing Subroutines are utilized; 

C TRPROB- computes TRANSITION PROBABILITIES 

c PaTu- C-T^PUTES identity of ne>*< paths 

C LIKmD- computes IHt LlKELIhOQD OF EACH PATH EXTENSION 

C p^rJj 3 p. C 0 ''PUTE 3 POSTERIf^P PROPS OF EaCH NEW RATH 

C SpROH- rU'MPUTFS POSTERink PROBS OF EACH STATE 

c SAVU- Saves The highest PROB PATHS 

c rPELis- FoRNS A trelIs of Saved paths 

c TRanSl- translates the letter estimate 

c 

c all Tables of consiants are stohed in common, 
c 

C**«*>/***'******n**<r»*i********» 5 l***'*»/'*****i**s»************'***»'»** 



Real l k h ."I 

T.nTEGEP ELMnaT,XHAT,PaThSV,SORT 

DIM£NSIU' LAHhOaCPSI , DU R ( 25 1 , I L.R A T E ( 25 1 , P I N ( ?5 , 3 9 ) 
OI.'tENSTGN LAMSAVC 759),DURSAVC 75D1,TLRSAV( 739) 
DtK£‘ SIGN L^M0(7S9'I ,P(759) ,r’S£LEM(fe) 

OIMEngIUN paThSv C25) , sort (25) 

data ISavE/BS/ 

D A T A L A M B 0 A / 2 5 * 5 / 

WATa ILRATt/'5*l9,s*?9,5<r5D,5*4 0,5*5M/ 

D A T A P / 7 5 9 * 1 . / 

OaT A L ' m5aV/75m*S/ ,DUR/25*1990, / 



167 



0610C3 
? 6232 i 
06300 
06430 
06500 
06600 
06700 
06800 
06430 
0 ? 0'40 
07130 
07230 
07330 
07400 
07530 
07600 
07 730 
07603 
07400 
08000 
: 08 t 33 
‘ 08200 
! 08303 
' 03400 
08503 
1 08630 
I 08733 

i 08800 

1 06400 
09300 

09103 

I 09230 

39303 
09403 
09503 
39603 
09730 
09756 
09803 
09°03 
15J0W3 
1 3 1 0 3 
13230 
10333 

I 1042? 

' 10500 

I 10603 

107 00 
10603 
, 12403 
113 fc? 
, 11133 
1120 '’' 
11 3 ? 3 
■ 11423 
11503 
11600 
11703 
118 ev? 
1 1 4 v:; 3 



data ILK5aV/ 75'0*20 / ,PAThSV/25«5/ 



c Fo« Each SAveo path, cqhpute; 

c transition PRQHaBILITY to men state (TPPROe); 

C ICEMTITY OF EmCH nEH PATH EXTEMOED (PATH); 

C lIKELIHOno OF EACH STATE EXTENSION (LIKHO)t 

c 

c 

00 13? IsI.ISaVE 

1 P A T H 5 I 

CALL TPPPOBCIPATH.LAMBDAm ,nUR(T) , I LR A T E ( T) , P I N ) 

CALL PATHCIpATM.LAHHnACI), OUP Cl ) ,ILRATECI)»LAH3AV, OURS A V , ILR' 
CALL LI^HOfZ.RN, T path, lambda Cn ,nijR(I) , 

2 ILRaTe (I) ,PIN.LkHDD 

103 Ca^'TI^ni£ 

C Having OBTAINED all nEN Paths, COMPUTE*. 

C POSTERIOR probability OF EACH NEW PaTh cprobp); 

C POSTERIOR PR0R46ILITY OR KEYSaTE.ELEM STATE, 

C CC^'DITIOMaI. mean estimate of speed CSPROB); 

c 

CAL L PR03P CP, PIN, ISAVE , LKHD) 

CALL 5PR0BCP,ISAVE,1LRSAV,PELM,KHaT, 

a SPOiAT.px) 

X h A T S 0 

IF CPX.gT,0,5) xhAT=\ 

c 

c Save t'-'e Paths jith highest probability, and 
C STORE T;h£ VaLUES CORRESPOND ING TO THESE PATHS; 

c 

CALL SA yEPCP. PATHS V,TSA wE,TMAX, LA MSAV,nURSAV, 

a ilrsav,l^mboa,do«, ilwate.sort) 

NO TO 1 
TYPE 103M.Z 

I 3?? FOPii A T C / / , T X , F 1 D , 7 , / I 
DO 1 INS i, ISA YE 

T> P£ no?, IN , P C IN) , PATnS Y C IN) , L amBOa C INI , nuR C INT , ILRaTE CINI 

a .L^^D (SORT CIN) ) 

1100 format c I X, i3,ax , Fi0,7 , sx , n, ?x , 13, ax ,F6. 1 , ax, i:s, ax, F10. 7) 

I CUiVTINtlE 

c 

C update TREILTS ■nITH 6 EN SaYFO MODES, AND 
C OBTaT.m letter state estimate; 

C 

Call irelis (ISA / E, Paths V, lambda, imax) 

a30 RtTuPh 

E^:D 
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2 P 13 B 

210 f -5 

2300 
2^00 
2500 
2^00 
27.00 
2fi00 
2900 
3000 
3100 
3200 
3300 
3<.O0 
3530 
3f>00 
3700 
3600 
390 0 
U000 
^ 1 0 0 
(1 2 0 
ii 300 
<•900 
4500 
460 ? 

4 7 00 
4800 
4900 
5000 
51 -3 0 
5200 
5300 
5400 
5530 
5600 

5 f 2 9 
58 03 
5 '>00 
60 3« 
0 U; 0 
620 0 
0 3 0 '0 
6400 

6 5 . 0 '? 

6630 

6 7 3 0 
.0800 

o 9 0 0 
. 7 0 0 0 

7 1 ,j0 
7 2 03 
73 J0 
7 4 00 
7500 
7600 
7 7 00 
7800 
79 0'/! 



S'JPROUTiMt TPFPO0(IP,LA.M0DA,nUR, ILFATE,P5 



C 

C 

C 

C 

C 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 






This 0 U. 3 POUTINP COPPUTEr. the TCAMSITTQN PR08A6IUITY 
ppCN Saved path ip to each state h and stores the 
Rtsuur r-i PciP,D). 

Variables; 

IP- IfiPUT SAVED Path lUt'^TITV 

lambda- tn-put Saved ltr state identity 
OUP- input saved ELEMENT DURATION 
ilpate- Input Saved data rate identity 
P- OUTPUT transition probability matrix 

the FOLLO^aNO Function subroutines are used; 

XTRaNS- returns TnE KEY3TATE TRANSITION PRCBA 6 ILITY 
DunDITIONED on element type AND DATA RATE 
PT=>AMS- peTuRnS Tf.E PaTK^CDNOITIONAL STATE TRANSITION PROB 






^ M ^ ^ ^ , 



DIMENSION P(25,30} , IELM3T (4.0.?) , RAMI (16) , ILAMXC 6 ) 
O^R'.SIO^ PIN( 3 ' 0 ) 



COMMON /BL'HLAM/tElmsTjILAHRILAMY 



C 

c L'jok up element type for ltw state lambda: 

r 

IF RAMaOA.NE. 3 ) GO TO 20 
DU 10 Ns 1,30 
P ( I P , N 1 s 0 , 

13 continue 

GiJ TO R 00 



23 I £LE Ns RAMI (I ELMS r (LAMBDA) ) 

C 

r CDMPmIE keySTaTE TRaMSITIQN PROBAdRIlY; 

C 

RTPXsXTRANS (IcLEM , oi^P, Rt?ATE) 

C 

C FOR Each state, compute state transition PPOBABRITY; 

c 

p o U M S 0 , 

00 1 MO !<sl,n 

f'C 130 1=1.5 

N S ( i - 1 1 * 6 + < 

-^EL -isK 

IPATEsI 

CALL PT R A nS('^ELM,I«aT£, lambda, TLRATE,FTRX,P5UM,PTN,N) 
100 CON'TInUE 



10 3 - 3 N = 1 , 3 
P ( IP , .0 SPIN (N) /PSU-^ 
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18 ? 3 ' 2)0 

I 3 t 30 

).83<50 

1340;^ 

13503 
13^10^ 
18700 
13300 
18‘)00 
19000 
19100 
19200 
19300 
19403 
19500 
19300 
1970^'' 
19833 
19900 
20003 
20100 
20200 
203 00 
23400 
23500 
20 tioa 
307-30 
20800 
20923 
21000 
21136 
21206 
21320 
21400 
21506 
21606 
21706 
213QO 
21900 
22060 
22126 
22206 
»2300 
224 00 
’2500 
22600 
227 36 
22800 
22900 
23300 
MU,3 
23200 
23303 
234 10 
23560 
23630 
23700 
23630 
2346; 3 



300 CONTINUE. 

206 return 

END 



function XT.3ANS tIELEH, 00, irate) 

c 

C This FINCTIUN ThPLEHENTS TWa CALCULATION OF KEYSTATE 
C TRANSITION POU3A0ILITY, COMOITICNEn On ELEMENT TYPE, 
C CURRENT OUPaTIOn, A, NO DATA RATE, 

C 

C VA.RIA6LE3; • 

C lELEM- INPUT CURRENT ELEMENT TYPE 

C 06- INPUT CURRENT ELEMENT OUR.MION 

C IRATE- INPUT CURRENT DATA RATE 

C 

c Tables in common contain density parms for each 

C ELEMENT TYPE, data RATE. 

C 

01 HEN SIGN KIMaP(o) , aPaRM( 3 ) 

Data kimap/i , 3 , i , 3 , 7 , 14 / 

Data APaRM/3.06'6, 1 .500, l ,660/ 



C 

C SCAuE duration and OBTAIN DENSITY PARAMETER: 
C 

MSCALE=KIHAP ( IELEM) 

RSCaLEs 1200,/mATF 
b0 = D0/ CM.SC4LE*R3CALE) 

Bis cOOi-S, } / tM5CAL£*R3CALE) 

IF CIELFm.EO.H) go to 26 
IF lI£L£M,tD.5) GO TQ 16 

AL°h A sMSCaLE*aPaRM C 1 ) 

GO TO 10? 

13 AtDHAs7,*APARMC2' 

GO TO 166 

20 A L. p M A s 1 a . * A P A R M C 3 ) 

166 IFCLM.LE.I.) go TQ 200 

IF C (PM.LT, 1 . ) . AND, CHI ,GT . I , n GO TO 30-0 
XTRa MSsEXp (.alpha* (31 -P6)) 

G'J TO 4 00 

26 6 Pi S 1 ,-0,'5*EXP (AL^hA* (31 - 1 , ) ) 
°Jsi.-6.5*e/PfALP'-iA*Cd0-l.)) 

X T P A M 3 s P I / P M 
GO 10 « 3 -* 

36 0 pIs.0,5*E/PC-AlPhA*(j1-1 .)) 

P6si.-0.H*ExPCALPHA*(H6-1.)) 
xTPawSsP 1 / a,,;. 
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P£T|JWN 

End 



inur'd 

jiittia-"? 

, 2^53?* 

I Jitb03 
1 a« 79'3 
24*533 
24903 
25333 
25133 
25203 
25330 
25400 
25500 
25533 
25703 
25803 
25933 
26003 
26100 
26232 
26303 
264 03 
26500 
26630 
26730 
; 26800 
I 26900 
27000 
27103 
J7203 
27300 
J7400 
J7503 
27633 
27700 
27303 
' J7903 
23000 
23103 
233^0 
2o300 
I 26403 
28503 
I 25530 
257 7 0 
23800 

2890.0 
29000 
29103 

' 29200 
i 29300 
294^10 
! 29500 
' 29530 
2970 ? 

2980.0 
29900 



4 00 



SUB POUT I .ME PTRanS (KELEM, I R A T E , L AM3Q A , ILRATE,PTRX, 
2 P. 5 ' 7 '«i,PT 6 i»Nl 



C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

r 

c 



c 

c 

c 

c 

c 



c 

c 

c 

c 

c 



««A«*A*««*«**ik*««* 



'*********' 



********* 



this FUmCTION SuBROUTIME RETUR74S THE PATH CONDITIONAL 
transition PROBABILITIES TO EACH ALLOWABLE STATE N. 

variables ; 

K£LcN- INPUT CURRENT ELEMENT STATE 

irate- Input current oata rate state 
LaMBOA- input identity qp current LTR state 
PTRX- TkouT KEYSTaTE TRANSITION PROBABILITY 

elemtr- Element transition probability matrix 



Function subroutine used? 

SPDTR- returns data RATE TANSITIQN PRObS, 
CONDITIONED ON CURRENT SPACE TYPE. 



**************•**************: 



**«**** 1 k 



DIMENSION TELHSTf400) , ILAM1 £16) , ELEMTR ( 1 B , 6 ) 
Cl. ME NS ION ILAMX (6) ,PIN(30) 

CONHCN/BLKLAN/ IELMST , ILAMl , ILAMX 
CunhOn/6LK ELM /elemtr 

IF THt SAVED element aNq THE ELEMENT nF THE STATE 
N '0 Which the PaTH IS BEINC, EXTENDED ARE THE 

Sane, then ThE state Trans prob i.s simply 

k£YSTaT£ TRANS PROR: 

IF 7KELEM,nE, ILAMI (IELMST CLAMROA) n GO TO 100 
P IN f N) SPTRX 

IF (lRATt.NE.3) PIN(N)s0, 

G U TO R 0 3 



otherwise; 

uRTAIN EuEN TRaNS PROB.S FROM TABLE: 

100 PEL£MsFlEmTR(1FlmST(LAMBDA),KELEm) 



C 

C NEXT COrlPUTE ElFM-CONO I T ION AL SPEED TRaNS PROP; 

C 

FRATEsSPfTP(TRATE,lLRATE,<eLEM,ILAMi(IELMST(LAMunA))) 

r 

C PTRANS IS '^r,E PRODUCT; 

C 

f-IN(N)s£l,-uTRX)*PFLEM*PRAT£ 

PSUMsPSijM + P In £N) 
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30^130 

30100 

30200 

30300 

30400 

30500 

30^100 

30700 

30800 

30900 

31000 

3U00' 

31233 

3l3e)0 

31400 

31500 

31603 

31733 

31900 

3l‘’03 

32000 

32100 

32203 

32300 

324&10 

32533 

32633 

32703 

32900 

32930 

33333 

33130 

33200 

33303 

33400 

33500 

33900 

33700 

33900 

33900 

34033 

34100 

34200 

34333 

34433 

34500 

34600 

34701 ^ 

34000 



35003 
35130 
35200 
35300 
3540 0 
35500 
35900 
35700 
35900 
35900 



return 

E^n 



Function spdtrciskt, iirt, isf.ln, ileln) 






c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 



TrtlS FUNCTIU»-J RETURNS THE DATA RATE (SPEED) TRANSITION 

probaoIlity based cn the current euen type, the auuow- 
ABUE transition PROeS ARE STORED IN THE Ta3LE RTRANS, 

V AK I a61.es : 

ISRT' data rate identity for state to which 

PATS IS BEING extended 

RRT- data rate On current PATH 
ISEL*^- FtEN TYPE FOR n£^t STATE 
ILELN- EL-En TYPE UN CURRENT PATH 



#**:»****H*t**)«’*-*<r«*****’*wi»'*»' 



trU-kH ■ 






dimension RTPANSCSi^) ,MEMPRCA, fe) , mEmDFL(S, 6) 
COMHON/BLKSPn/RTRANS. MEMPR 
CUH0On/QI,kRaT/“'1EMOEL 



C 

C IF SAVED element and NEw ELEMENT ARE THF 

c Same, then there can be no speed change; 

c 

Tr (ILEUM, NE.ISEL’M) GO TQ 10(0 
SPO TPa 1 . 

I*-' CISRT.NE.3) SPD7RS0, 

GO TO 3 3'‘ 



C 

C OTHERWISE, OBTAIN SPEED TRANSITION pRQB; 
C 

IS I IOEL = mE'iof!^ tIi_£LM, rsELM) 
riDlsMF«iPH (ilELM, ISELM) 

II- UNUI ,NE. 0 ) GO TO ?d'^ 

SPO TRsOJ . 

GiJ TO 30M 



<200 lOcLSPs ( (SRT-3) *IPFL 

S?OTR=RTRaNS(ISRT, INOI) 
I3RArEsIi..RT4.ToeLSP 
Ir ( (SRATF.GI ,oO) SPOTR = 0. 
IF (ISRATF.lt. 10) 3PDTR = 0. 

i 0 0 P E T ;j R N 

End 
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SUFiRO'jT INh PATH(IP,LAM3DA,nuR, 1 L P A T E , 1. A HS 4 V , DUP 3 A V , ILRSaV) 



3ib2)f30 

3610!? 

362^0 

36330 

36403 

36500 

36630 

36730 

36800 

36600 

1 37000 
1 37130 
1 37200 
I37303 

! 37400 
37530 
37600 
'37700 
37800 

37 <^20 
.38000 
138130 

38200 

3830? 

33400 

38533 

38600 

38 700 
38800 

138900 
1 39f'00 
(39103 
1 3920 3 
! 39330 
1 39400 
39500 
1 3960'? 
39700 
398S0 
3993 0 
40000 
40100 
■ 40200 
43300 
40400 
43500 

40fei0 0 

437^0 

47 j 800 

436v»0 

41000 
4ll'iM 
4 1 2 ;] 0 
4l3o'^ 
4140/ 
41500 
4160? 
417 0 0 
41800 
41900 






f-'ATH C0^!PlJTES The LTW state, OUPATION, A\'D data pate of 
Each ^Ew path extended to state w. 



VARIABLES: 

IP- 

L AMPOA- 

nuR- 

ILRaTH- 

L A H S A V - 

OUPSAV- 

ILPSav- 

J- 



SAVEO PATH identity 

LTR state of SAVF-D path 

duration of element on saved Path 

d&ta rate of element on saved path 

NEs'i LTW states for EACH PATH EXTENSION 

NF'-4 ELEM DUPATIQfiS FOP EaCH PATH EXTENSION 

NEW DATA Rates for Each path extension 

inEH path IDENTITY 



The letter fRANSITICN TaPLE, MEmFCN, IS stored in common. 






nr-’ENSION LAMSAVC 75^ ) , OURS AV ( 75MT,ILRSAV( 750) 
DIHE'iSIO^' HgM|.-CN(aO0, A) , lELMST (4D0) , lUAMi (IS) 
Or'ENSION lU '.MX (S) , ISX (6) ,MEMi)EL C 616) 

CGMmQN/PLKLAM/ IELhST , ILAHI , ILAMX 
CDHoaN/dLKMEH/MEMECN 
COMHON/ciLKS/lSX 
COHhOU/SLKR A r/MPMDEE 

C FQR Each EUEM state X, ANO EACH SPEED I, COMPUTE: 

c 

no 100 1=1.5 
DO 1?.3 Xsi.s 

c 

C STATE IDENTITY Vi; 

C 

Ns (1-1 ) *6 + K 
C 

c .'iEw PATH identity: 

C 

J 3 ( I P - 1 3 n 3 0 •(. ,M 

c 

C Nf.. l7R state: 

c 

IF (LAMBDA. V'E. a) CO TO 5? 

LAf' SAV ( j) s ’ 

CO to laa 

50 LAMSAV (J) s.-1LMECN(LAMB0A,X) 

IF (LAM5AV (J) ,EO,a) r;o to i^b 

r 

c !.e-< ouRATiijN: 

c 

C Oi-iTMlN xEfSTATE OP SAVED PATH anD MEin STATE: 

C 
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42132 

4222^1 

42330 

82430 

42530 

42630 

42720 

42830 

42900 

43230 

43133 

43230 

43330 

43400 

43530 

43600 

43730 

43830 

43900 

44030 

44120 

44200 

44330 

44430 

44503 

44633 

44700 

44803 

44900 

45030 

45130 

45230 

45300 

45400 

45530 

456K0 

45700 

45830 

45900 

46030 

4bl'/i0 

46200 

4b300 

46400 

«65C0 

46630 

467 22 

468 20 
46903 
47^30 
47133 
47230 
47333 
4743'3 
47533 
4760 0 
47?4,a 
4 78^,0 

47930 



iLEtMs ILAMl (lELMSr a AhBDAD ) 

IXLsILaMX CILELM) 

IaSsISX (X] 

C 

C calculate rnijRATIUN; 

C 

L'iJRSAV ( J) sOURi» (ll-IX 3 -rXL + 2 i»IXS*iyL) +S. 
C 

C N t w D A r A ^ A T E : 

c 

ILRSAV ( J) 3ILRATE+ (1-3) -HF.MOEL ( I UEL^ 1 K ) 

2 J 3 RETURN 
£NU 



SJ-.JROJTINE LIKNOCZ.RN, I P , L A MBO A , IJijR , 

2 I. cPATtiPiLK^'n) 

C******j»**»r*******»)»**i**)»***)***<r*'»*^***'(t******'*'*********'(l* 

C 

C This SURSOilllNE calculates, for each path 
c extension to state n, T'-*E likelihood of that 

C ThAnSiTjCn ilVEN THE mEaSURE'^ENT Z, IT USES 

c AN array of linear (Kalman) filters to do 30 . 
c 

C VARIABLES; 

C Z- INPUT measurement 

C Rn- in»ut nuise power estimate 

c IP- INPUT Saved path identity 

c Lambda- input saved ltr state iuentity 

c D‘J»- INPUT Saved duration of element on path ip 

c ilRate- input Saved oata pate (speed) 

C P- INPUT transition probabilities 

C L^HD- OUTPUT computed LIKELIHOODS FOR EACH TRANS 

c 

C SL 3 R 0 U times used: 

C KaLFIL- Kalman filter FOP EACH NEW PATH 

c 

C*'*'******'«i*i«******ilf)***#**j****ji|'**'k**'***)lr'*’**»*i»<t’******'***ik( 4 * 

«EAU LKHn,LKHOJ 

CIMEMSION P ( 25 , 30 ) ,LXHD ( 750 ) 

dimension lELMSr (« 00 ) , iLAHUlb) I ILAmX ( 6 ) 

DIMENSION ISV( 6 )) 

C JM"'CM/BLKL^m/^£Lmst^ ILaMI , ILAMX 
CU'^^'0•N/bLKS/ I3X 



C obtain saved kEYSTATE; 

c 



^cLEMstuAMldELMSTfUAf'BDAl) 
TuXsiLAMY (KELEM) 
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(I8K0U 








il81n5P5 


C 






ll82a« 


c 


FCR 


Each state: 


(I8340 


c 












CU 130 K=1,S 


a85(?0 






no 133 1=1,5 


H3800 


c 






48700 


c 


obtain kevstate:, w4T£ state, state n,mei^ node; 


483219 


c 






48<’00 






TxSsISX (K) 


494*yC' 






ISRaTEsI 


491/32 






Ns (I-l ) *6+K 


49220 






J5 (IP-1 ) *33tN 


49322 






R I N = P ( I p , iN ) 


49903 


c 






49530 


c 


COMBUfF AND STORE LIKELIHOOD: 


49800 


c 




• 


49700 






CALL KALFIL(Z,TP,RN,ILX,IXS,KEL£H,J,ISRATE 


49300 




a 


UUR, Il.PATE,PIN,LKHnj) 


49902 








5200 2 






LKHO Cj ) St KHL'J 


50100 






GO TO MB 


50200 






IF (PIN.LP , 1 .c-3fel GO TO 133 


50300 






type 1333, IP,Z»LAflODA,K,ILRATE, nRATE.OUR, 


509 03 




IS03 


format fix, la, 1 X,FS.3,ax, I3,2y, ii,2X, i5,ax, 


53500 




a 


ax,F8.S,ax.F8.a,pX,FA,a) 


50603 








50733 




1 3 U 


CONTINUE 


50803 






R t T u R ''-i 


5093M 






FNO 


51333 








51103 








5l203 
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00201 ^ 

0330 '^ 

034013 

0060 ^ 

00700 



00903 
015100 
01100 
01200 
0l30'3 
01403 
01500 
01603 
0 1 7 ej 0 
0180M 
31900 
02030 
32100 
02200 
023?0 
02400 
02530 
12600 
027031 

02830 

02930 

03000 

03130 

03230 

13300 

03400 

03500 

03600 

03700 

13800 

03900 

040 ti 0 

04100 

04230 

343055 

14400 

34500 

14803 

04731^ 

04300 

04900 

055100 

15100 

15200 

053k)0 

15400 

05500 

35600 

157 1/0 
05 8 
059.^55 

065>20 



subrout I ME KALFILtZ, TP,RN, lUK, IXS.KELEM, 
JNOOE, I S« ATE, OUR, ILRATE,PlN,LKHnj3 



C* 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

n 

c 

c 

c 

c 

Cx 



x**jtx***x***x* 



n H -k it 'k ii 



This SUBRfJUTTtNE COMPUTES THE ARRAY OF KaLMAN FILTER 
RECURSIQMS UStO TO DETERMINE THE LIKELIHOODS, 



Variables; 

z- 

IP- 

Rm- 

ILX- 

IXS- 

KcLEH- 

ISRaTE- 

OUP" 

ILPaTE- 

» IM- 
I.KHOJ- 



InPuT measurement 

Inpijt Path identity 

Input noise power estimate 

input SavEO KEYSTaTE on path ip 

Input ketstat of new node 

input elem state of new node 

input speed state of new node 

INPy current duration of element on 

input speed state on path ip 

trapjS prob from Path ip tq node n 

output calculated likelihood value 



IP 



subroutines used 

model- obtains the SIGNAL-STATE-DEPEMDENT linear 
model fur T,iE KALMAN FILTER RECURSIONS 



*X«»*»****: 






P £ A u L K h n J 

OI’MENSI5jN YKKIP CP51 , PKKIP (25 9 
DIMENSION Y^<SV (7551) , PKKSV (7509 



CfJNMON/BLKSVT/YKKlP,PKKIP, YKKSV,PkKSV 



data Y<KlP/25x.5/,PKKIP/25x, 10/ 
data P I NM IN/, 00,0 10/ 

C 

C IF TRANSITION probability IS VERY SMALL, DON'T 
C BQTrirR WITH LIKELIHOOD CALCULATION; 

C 

TF (PIn,GT,PINMIN9 GO TO 1,00 
! , H ij J s 3 , 

GO TO 

C 

C OBT«Ii-. STaTE-oEPENHEnt nODEL PARAMETERS; 

c 

100 Call model C0UR,KELEM,ILRATF,TSRaTE,IXS,PHI,QA,HZ9 

c 

C GlT previous ESTI.maTES fop path ip 

c 

Y = Y ;< .< I p (I P ) 

Px N sPK^ IP ( IP) 

c 

C li'PutMENT <alhaN filter EUR This TR ANSI r ion; 

c 
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061^0 
06200 
06300 
06400 
06500 
06600 
06700 
06600 
06600 
07000 
07100 
07200 
07300 
07400 
07500 
07600 
07700 
07600 
0760 PI 
0800M 
0810 !?) 
08200 
08300 
08400 
03500 
06600 
08700 
06800 
08900 
09000 
09100 
09200 
0930 ? 
09403 
09500 
09603 
0970t', 
09903 
'09900 
13P30 

13103 
13233 
13303 
13403 
10500 
10630 
10700 
10300 
10900 
.1000 
1100 
1230 
1300 
UOO 
1530 
1600 
170 0 
1600 
Poe 

f 2 c< 53 !s 



YPREDaPHItYKK 

PpRe 05 PHI*PKK*PHl+QA 

P 2 sHZ*PPREn+RN 

^'ZlNVsl ,/PZ 

GsPPRtO»HZ«PZINV 

PEST* ( 1 ,-G*HZ) *PPRED 

ZRsZ-nZ*YPR£P 



YkKSV(JNOOE)sVPRED+G*ZR 
PKKSV ( jwocej sPEST 

IF (YKKSV CJ.'JQOe) ,LE..0l) YkKSV ( JNQOE) = ,01 

As 0 , 5 *P 2 INY*ZR **2 
IF(a.LE,1000.) go to 200 

L'C 9 CJs 0 , 

G G TO ^03 



20 0 L^H0J5 ( I ./SORT CPZ) ) *EXP(-A) 

GO TO a00 

T TPE 1030, Z,H2,QA,PHI ,PZ,ZR,G,PEST» YKK, YKKSV (JNOHE) ,LKHOJ 
1000 FijRMATClY, I I CFG.3, IX) , / ) 

<4 0 la R L T I, j R N 

Ei'^iO 



SUbPOUTiME P'OCEL (nUR, lELM, ILR,IS«,IXS,phI,0A,h2) 



C * * 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

r 

c 

c * * 



this StiBROUTTNE COMPUTES THE PARAMETERS OF T^E 
OHSERYAriOM STATE TRANSITION MATRIX PHI, TH£ 
^EaSURE.MENT matrix, AMO THE COVARIANCES, 



VARIABLES; 
D JR- 
I cLM- 
lUR- 
ISR- 
IXS- 

P H I a • 
SIGNAL 
Q A - 
M 2 - 



IMp'JT ELEMENT DURATION 

INPUT element type 

INPUT SAVED RATE 

r'pUT RATE OF NEW state 

INPUT KEY3TATE OF NEW STATE 

QUT»UT STATE TRANSITION MATRIX 



ENTRY FOR 



amplitude state 

OUTPUT covariance for AMPLITUDE STATE 

GliTPur measurement matrix value 






C 

C COMPUTE MEASUREf.ENT COEFFICIENT; 
C 

MZslXS 
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12100 
12220 
I 230 i<^ 
12«00 
12500 
12<)20 
1^700 
12?00 
12‘)00 
13000 
13100 
13200 
13390 
13400 
13500 
13600 
13700 
13300 
13<)30 
14000 
14J00 
ia 200 
14300 
1<)400 
14500 
14600 
14700 
14300 
14930 
15023 
15100 
15230 
15330 
15400 
15522 
15600 
15702 
15000 
■15902 
16030 
16102 
16230 
16302 
16402 
16500 
16600 
1670P 
16000 
169,jO 
i 7 2 0 0 
,7130 
7200 
7300 
7402 
7530 
7600 

7730 
700 0 
I 7900 

I 300j« 



r 

C COMPUTE PHI ANO Ah°LITUOE STATE 'VARIANCE (Q); 
C 

Pl=ia02./ILR 

3aI)DSsOUR/R1 

IP (BAUDS. GE. 14.1 BAuns=14. 

Ir(lFLM.GE.3) GO TO 100 

QAs ,0001 

PHIsl . 

GO TO 300 

J00 IFCI^S.EO.O) GO TO 200 
Pm! 3 1 , 

nAs0.l5*EXPC2.6*(BAUDS-14,)) 

QA5QA + ,01 *BaUC 3*EXP (.2* CU'eAUDS) ) 

GO TO 302 

200 ySAMPs22.4*Rl 

PhlslK,** f-2/XSAMpl 
IF (BAUDS. GE. 14.) PHIsl, 

Q A 3 3 , 

300 R£TijR.\ 

END 



subroutine PRQ3P (P,PIm, ISAVE.UKHO) 



C 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 



PSOUP COMPUTES the posterior PROBABILITY OF EACH 
,N t Path, 

Variables: 

P- INPUT: SAVED PROBS OF PRIOR PATHS 

OUTPUT :COHRL'TFn POSTERIOR PROBS OF NEw PATHS 
PIN- INPUT transition PRQU A8TLITIES 
lkhq- input lkelthooos of each TPANSTTTON 
P3UU- normalizing constant (SUM OF P(J)) 



t'**'*)****************’**********' 



' t* * * * 1# * * 



real L K i-1 0 

niHENSIQN PC 750) ,PTN(25,30) ,LKHD( 750) 
OIMENSTCN P3AV( 752) 



R U A X = 2 . 

P GUI 1 30, 

C 

C FOR Each SAVPD hath, each transition: 

c 

OU 120 Isl,ISAVE 

no 100 Nsi.ip 

C 

C CQUPulE IOENTITY of nEN PATH; 
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18103 
1822H 
18300 
18400 
18500 
13600 
18700 
18300 
18900 
19000 
19100 
19200 
19300 
19400 
19503 
19630 
19703 
19330 
19900 
22000 
Jjj 1 0 0 

mu 

20330 

23400 

23500 

20600 

20730 

20330 

23930 

21330 

2U30 

21230 

21300 

21430 

21530 

21630 

51730 

21803 

21990 

'22000 

52100 

52200 

52330 

22400 

52530 

52630 



52330 

229 w '3 

53003 

53100 

53230 

53300 

534y3 

53530 

53609 

53790 

53803 

539 v :,3 

54090 



C 

Js (J-n « 550 + 14 

C 

C PRODUCT UF PROBS, aDO TO PSUP 
C 

PSAV (J) sP (I) *PIN(I ,N) *LKHD (J3 
PSlJMsPSUf' + PSAV ( J ) 

IF (psav ( j) .le.pmax) r,n to u’^i 

• PMAXaPSAVCJJ 
COMTTNJUf 
C 

C normalize to get PRQBA0ILI ties; SAVE; 

c 

NIs3v)*T5AVF 
OU 25113 jsl.Nj 
P CJ) sPSAV (J) /PSUM 
B0.-J CONTINUE 



R £ T U P N 
EivO 



Subroutine sproscp.isave.ilrsav^pelMiKhat, 
2 spdhat^px) 



c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 









SHRUB COMPUTES TH£ POSTERIOR PROBS OF TpE ELEMENT 
STaTESiOATa Rate states, and keystates by summing 
OVER the appropriate PATmS. 

Variable: 

p- INPUT Path probabilities 

TSAVE- NUMBER OF PaTHS SAVED 

PSELEM- output EL£'‘^£NT pros 

spOr^AT- Output speed estimate (data rate npm) 

PX- OUTPUT KEY3TATE PROpAPTLITY 



!![**★****»★*****;*»★'«* 



J*********************** 



dimension PCTS'^) ,PSELEM(6I , ILRS AV (755J) 



c 

C iNiriALIZE; 

c 

SPOHATs/ 1. 
p X s a . 

c 

r, FOR Each state extension of path m: 

C UBTaTn element state f^RQ0S,KEY5TATE PROPS, SPEED EST; 

c 

Du 130 K s 1 , b 

PSEl.FM SPI ^ 
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jatae 

24300 
24400 
24500 
i 24620 
I 24700 
24^90 
! 24900 
! 25000 
25100 
25200 
25300 
25400 
25500 
25600 
25700 
251300 
25900 
1 26000 
! 26103 
26200 
26300 
26400 
26530 
26600 
26700 
26300 
; 26900 
I 27330 
27100 
I 27230 
! 27330 
27400 
27500 
) 27630 

27 70« 

■ 27900 
' 27903 
I 23003 
23100 
28203 
23330 
26430 
26500 
23600 
23 7 30 
23330 
23900 
290 00 
29100 
29200 
29300 
29400 

29530 
29600 
297 33 
2990 0 
2 9 9 3 3 
3013 00 



GO 100 1=1,5 
N»Cl-l)*6+K 
no 100 MSI , isave 

J 3 ( i'1 - 1 ) * 3 0 + N 

P.5El£H(/ 0 sPSELEM (K) fP C J) 
SP0HAT3SPn'9AT+U.RSAV CJ) ^P(J) 
IFCK.GT,?) GO TO 100 
PXsPX+P (J) 

100 CCNrT'N'lE 

PELMsO, 

no 320 Ksi,6 

IF (PSEUEM(K) ,uT,PELM) go TO 200 
?£LMsPS£UEM(K) 

Ki»»A I SK 

202 CO.VT INlUE 

P t T u P N 
EnO 



SoaROuTINE SAVEP(P,PATHSV,ISAVE,IMAX,UAHSAV, 
2 GURSAV, IIkSAV,LAMBOA,OUR, I LP ATE, SORT) 



C 

C 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 






This subroutine performs the algorithm to save 
The paThs .*JiTh highest posterior probagilit t, 
ir will Save a hInIIMUM of 7 PATHS (CME FOR EACH 
element STaTF AM) OME ACOITTONAu MCUE) , AMO 
A maximum qp 25 Paths. within these limits, it 
Saves QNLT enough TU make the total saved ' PROBA dlLITV 
EQUAL TO PORT, 

AUDIT I'^NALLV, it resorts THE L AMPQA , DUP , AND ILRATE 
arrays to CGRRESPONO to the saved nudes. 



variables; 

?- 

PAThSV. 

ISAVE- 

liiAX- 
L A ■ '> S A V . 
C LI R s A V ■ 
ILRSA V- 
LA-'BOa- 

OllP- 

I L R A Y E . 



INPUT probability array OF NEW NODES 

CuTPur array of the previous nodes to 
WHICH THE Saved nodes are connected, 

INPUT; MO, OF previous MODES SAVED 
aijTPUl; NO, DP nodes saved AT current stage 

INDEX OF nIGHESr PROBABILITY NOOE 

Input array cf i.tr states at each new node 

INPUT ARRAY OF SAVED DURATIONS 

INPUT array of saved RATES 

OUTPUT array of saved LIR STATES, SORTED 

ACCCRiJlNG Tfj PRuBABILITY 

OUTPUT array OF SORTED OURATIO^iS 

Output arpay of sorted rates 



;**#*****-»*»**#j,*»* 









iNlEGiiP PAThSV, SORT 

or^ENSlCfN P( 752 ) , PATHSV ( 25 ) , PSAV ( 25 ) , SORT ( 25 ) 
dimension" LAmSaV( 750 ),GURSaV( 750 ),ILRSAV( 750 ) 
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3010^ 
302012 
3030'3 
30400 
30500 
30600 
30700 
30800 
30900 
31000 
31100 
31200 
31300 
31400 
31500 
31600 
31700 
31800 
31900 
32000 
32100 
32200 
32300 
32900 
32500 
32600 
1 32700 
32800 
32900 
33000 
33133 
33200 
33303 
33903 
33530 
33603 
33700 
33803 
33903 
3930 3 
39100 
34200 
34300 

34400 

34500 
34603 
34703 
34803 
34900 
35000 
351 00 
35200 
35303 
354 00 
355ifl 0 
35603 
357 0 3 
35830 
35900 
36033 



OI’^fcNoIOM UA;iB 0A(25) ,0UR(?5) , ILRAieCaSJ 
OIMEMSION YKKIPC253 ,PKKIPCa53 
01 PENSION YKKSV (750) ,P<KJ;V (753) 

DIMENSION ICONV(25) 

C0MMQN/BtKSVl/YKKIP,PKKIP,y;<KSV,PKK3V 
data P0PT/,P3/ 

N 3 A V = 0 
P5UMSU, 

C 

C select six highest PRGb element state NODES; 
C 

OU 200 i<sl,b 
P 10 A X s 0 , 

DO 120 IPal,ISAV£ 

00 100 1*1 »S 
Js (IP-1) *30+ (I-n +S + K 
IF (P (J) .LT.PNaX) go to 100 
P'lAxsP (J) 

JSAVaJ 

IPSAVsI? 

100 continue 

IF (PMAX.Gc, 0.003001 J GO TQ 150 
GO TO 200 



150 N3A VsHSAV* 1 

PSUMspSUf^ + PMAX 
P34V (NSAV) sPMAX 
Pa IhSV CinSaV) sIPSAV 
SORT (NSAV) s JSAV 
200 CONTINUE 



C 

C select enough additional NODES TO hakE TOTAL 
C PPOtJ/BlLlTY SAVED EQUAL TO PCPT, OR A MAX 
C OF 25: 

C 

523 p I' I A X = VJ , 

DO 533 IPsl , ISAVE 
no 500 NS I ,30 
Js (IP-1) *30 + N 
on 5iy Isi.mSaV 
IF (J.EQ.SORT Cl) ) GO TO 500 
510 CONT TNUE 

IF (P C J) .LE.FMaX) go to 510 

PMAX sp ( J ) 

J 3 A V = J 
I P S A V S T P 
500 CCA'TIN'JE 

PSUMspSUM+PNAX 
!• I b A V = ' J S A V + 1 
P 5 A V C ■ i S A V ) s p M A X 
PaThSV(’mSaV)3IPSAV 
SOFT CNSaV) s JSAV 
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361i3i? 




IF (PSUM,GE,POPTJ GO TO tm 






IF CnSaV.GE.25 ) GO TO &P3 


3630a 




GO TO 523 


36did0 






3o500 


C 




36600 


C NEW 


I3AVE EQUALS NO, OF NODES SAVED: 


36700 


C 




36300 




ISAVEaNSAV 


36900 






37000 


C 




37100 


C SORT THE SAVED ARRAYS TO OBTAIN THE ARRA 


37200 


C TO 


BE USED FOR THE NEXT ITERATION: 


37300 


c ALSO obtain highest pkobability node: 


37900 


C 




37600 




CQ 700 Isl,ISAVe 


37700 




P (I) aPSAV (I) /PSUM 


38P0 




LAMoOA Cn aLAMSAV CSOPT (in 


36200 




OuP cn sOURSAV (SORT (1) ) 


38300 




ILRaTECI) siLRSAV (SORT (I) ) 


38900 




YKKIP ( I ) = YKKSv (SCRT(I)I 


3a'300 




PNK IP C n =P'<<<5V (SORT (I) ) 


38600 




CONTINUE 


38700 






38800 




DU 79!3 I = 1*I3aVE 


38900 




icoNv c n = 1 


39000 


7^3 


CONTINUE 


39130 






39200 




I34VNIsISaV£-1 


39300 




CO 630 N=l,I5.AVhl 


39900 




IF CiCONV (N) .EQ.a) GO TO 303 


39500 






39630 




NPLuSl aN+i 


39790 




DO ai0 Ka.NPLUSl , ISAVE 


39800 




IF CICONV (KI .EQ.3) GO TO 610 


39900 






<18030 




IF ( ILRATE (K) .NE. ILPaTE (N) ) GO TO 813 


<13130 




IF (OUR .Nt.CUR (N)) GO TO BID 


«8200 




IF CLAM30A (KD ,NE, lambda (N)) GO TO 813 


H3300 




ICONV (K) 50 


«39^!0 






«2500 


t 1 '■;) 


CONTINUE 


«e 600 


0 '3 a 


CO'^'TlNUe 


<I3730 






<10833 




PoUt1S0 • 


<10903 




N s 1 


<11000. 




DO 90'3 ts2,ISAVE 


«1U0 




IF (ICONV m .E0.3) GO TO 900 


«1220 




N 3 N ♦ 1 


n303 




lambda f n) slahboa rn 


«19 30 




f)UR (N) SOUR ( I I 


«1500 




ILRATE (NI sILRaTE (I) 


<11633 




YsKI?(N3syKi<IP(l) 


n703 




PK-< IP (N) =PK^ IP f 1 ) 


11800 




PaThSV(n)sPaTHSV(I) 


11903 




SOP r (N) ssoR I c n 


1200 3 




p(n 3 =pcn 


12100 




R$UM = PSUf' + P (N) 


12230 


q-3 0 


CONTINUE 


12300 






12900 




ISA ; E s \> 
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il255i? 

J27ij0 

112710 

«720 

(2730 

1128.40 

J2<500 

«3oa0 

43200 



r M 4 X S y , 

DO 9'50 Isi,ISAV£ 
f’ (I) =P Cl) /P3UM 
ir (P (I) ,U£.PMAX) GO TO 950 
PMAXsP Cl) 

I P A X s I 

95y COMfCNiJE 



PcTUPn 

END 
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f0l00 
002i!)0 
00300 
00400 
00500 
00600 
00700 
00800 
‘ 009P0 
01000 
01100 
01200 
01300 

014100 

01500 
|, 016S0 
'101700 
'01800 
“01900 
02000 
02100 
02200 
02300 
02400 
02500 
02600 
02700 
02800 
02900 
03000 
03100 
03200 
03300 
03400 
03500 
03600 
*3700 
03300 
03900 
00000 
04100 
04200 
04300 
04400 
045l(t0 
04600 
04700 
"4800 
04900 
05000 
0510? 
05200 
15300 
35400 
35500 
15607) 
*5700 
*5800 
*5900 
*600'7» 



SoBROUTTNt TREUS (ISA VE, PATHS'/ , lambda, IM AX) 

C 

c This suQROLiTif'.e stores the saved nodes at each 

c stage AMO FORMS the TREE OF SAVED oaTHS LINKING 
C The nodes. OECODir4G IS ACCOMPLISHED BY FIMOING 
C Ti-E convergent path if it occurs within a maximum 
C delay set 8Y the PARAMETEi9 noelay, if convergence 
c TO A single Path odes not occur, then decoding is 

C DONE BY REAqImg THE LETTER QN THE PATH WITH HIGHEST 
C PROBAaiLlTY, 

c 



integer FTHTRL,PATHSV 

dimension PaThSV f 25 ) , lambda (?5) , P IHTRL (200 , 25) 
DIMENSION UMOSAV (200,25) , IPNOO (25) , LTRSV (200) 

C OHM ON/ al.K END/ I end 

data PTHTRL/5000*5/, LMDS AV/59'00*5/ 

OaTa N/0/, mUELAY/200/ 

data iPNOD/BSi* 1 / , NCALL/y/ , nm ax / O/ , MMAX/0/ 

C 

C keep average of ISAVE,N0EL for data analysis: 

c 

NCALLsNCALL+1 

IF CIEM^.^'£, n GO to 10 

ISAvGsXS AVG 

NlIL AVGsXDUAVG 

ItND=0 

type 2000, T3AVG,NOLaVG 

2000 format (IX, *AVG NO OF PATHS SAVED: ',T2,2X, 

2 'AVG decode delay: *,I3) 

TvPe 3000, XMMaX, XNMAX 

3000 format ( IX, 'PERCENT OF TIME PATh$525: ',F3.2, 

2 2X,*pERCFNT of time OELAY=200: *,E5,2) 

ACCEPT 2000, HAlT 

IW XSAVGs (XSAVG* (MCAUL-l ) +ISAVE) /MCALL 

XDlaVGs (XOLAVG* (NCALL-1 ) +fiO£L ) / NC ALL 
IF (^!DEL,^E,^•DELAY) GO TO 20 
KMAXS'NMAX + 1 
XinMAXsNMAX 
XNMaX = XNM,\X/NCALU 
20 IE (ISavE.N:F,25) go TO 30 

Ax = MMaX+1 
X'^^MAXaMMAX 

AXsXMMaX/NC ALl. 

30 CONTINUE 



C 

C STORE PATHS'/ AMO CORRESPONDING LAMBDA IN THF 

c trellis using a circular buffer of length "DFLAY: 

r 

N ? N + I 

IF (r ,EQ,Ml-£LAY + 1 ) N = 1 
NQ 100 1 = 1, IS A Vt 
PTMTRl (N, n sPaThSV (I) 
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J6lfc0 




LNiOSAV CN, n 5LA0BDA (I) 


062055 

06300 


100 


CONTINUE 


06«00 


C 




06500 


C 


PEWPOHM DYNAMIC PkOGRA.M ROUTINE TQ FIND 


06602 


c 


convergent Path: 


06700 


C 




06800 




Ks0 


06900 




00 180 1 = 1, I SAVE 


070*30 




iPNonin = 1 


07100 

07200 


130 


CONTINUE 


07300 


190 


K = K ♦ 1 


07'J00 




IF CK.cG.NOELaY) go to 700 


07500 




DO ?00 IP=1,ISAVE 


07600 




TsN-K+1 


07700 




IF (I.L£«0O IsNOELAY + I 


07900 




IPNOOCIP) sPTHTRU (I , IPNOO (IP) 1 


07900 




IF (IP.eO, I<^aV) IPMAXs IPMOD ( IP) 


06'330 

08100 


200 


CQNT I NUE 


08202 


C 


IF mLL nodes are equal, THEN PATHS CONVERGE: 


03330 


C 




08400 




DC 3(30 IEO = a,ISAVE 


08530 




IF (IPNQO Cn .NE. 1P^'0D (lEQ) ) GO TO iRy 


09600 

08700 


3 70 


CONI INUE 


08800 


C 




08900 


c 


Paths converge; set nqel: 


09000 


c 




09100 

09230 




NDEL = K-*-1 


09300 


c 




09430 


c 


IF POINT QF convergence IS SAME AS IT WAS QN 


09500 


c 


LAST call, them no need TO RE-DECCDE SAME NODE: 


09600 


c 




09730 

09800 




IF (NDEL.EJ.NOELST+n GO TO 800 


09900 


c 




13000 


c 


IF POINT OF CONVERGENCE OCCURS AT SAME DELAY AS 


10100 


c 


LAST call, then translate: 


13200 


c 




1S300 




IF (riDEL.NE.NOcLST) GO TO 350 


13400 




laN-NDEL+l 


13500 




IFn,LE,0) IsMDELAY+I 


l0h&0 




LTRaLMOSAVCI, IPNODd) ) 


13700 




CALL TRANSLCLTR) 


13800 

13900 




GO TO 800 


110B0 


c 


QInEP^ISE, point of CONVERGENCE HAS OCCUKED 


111 00 


c 


earlier on this Call, so need to translate 


11230 


c 


EVERYTMISn wIN Tv,f rONVERGENT PATH FROM 


11330 


c 


RRE'nOUS POINT QF CONVERGENCE TO THIS POINT: 


11400 

US00 


c 




1160 0 


350 


i ‘<C- 0 


11700 




IF SIP, vOD (1 ) 


118,J0 




eu 400 sh'Af L , NOELSr 


11930 




>«- 1) S K D + l 


120'/10 




IsN-K+1 
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n o o 



IFCI.LE.M) IsnOEUAV+I 
UTRSV CKD) sLMDSAV f I , IP) 
IP=PThTRL(I, IP) 
CONTI.'^ue 



c 

C REVERSE ORDER OF OECOOEO LETTERS, SIMCE THEY 

C ^ERE obtained from THE TRELLIS IN REVERSE; 

c Translate each: 
c 



500 


DO 50J 1 = 1, FD 
LTRsLTRSV CKD-I + l ) 
CALL TRaNSLCLTR) 
continue 
GO TO 800 


7 9<i 


CONTINUE 



c 

C PmThS Nav/£ not COMVERLEO AT haXIMIJm ALLC'^ABLE 
C ilELAf, so translate what IS ON dIGHEST 
c probabILITv Path: 
c 

NLELsnOELaY 

I SN-NOELAY+I 

1*^(1. LE.O) isNOELAY + I 

L TRsLHOSav Cl , IPHAX) 

CALL TRANSLCLTR) 

C 

C PRUNE AWAY nodes WHICH ARE NOT ON 

C This pmh: 

C 

DO 75 ^} K = 1,I5aVE 

. IF CIPnOO CK) ,EO. IPhax) go TO 75B 
LAHHOA (K) 30 
75>J CONTINUE 



8«K ’“OElSI sNCEL 
R c. T u R i'i 
END 



SlGROuTI~E TRhMSLCLTR) 



Thts subroutine produces the output TEYT on a CRT, 

C IT uses the simple FOR^^aTUNG rules DESCPIoEO in the 
c text. 
c 

Ct*'«*»******«»***«*j«****'«**********',(**********<**1*llrilt*******’* 

I‘'T£f;E>^ SPFUaG , ELMHa T , ELMOUT 

OIME'VSION LTPSAPfaO0),lALPH(7a),I8LANK(a(?9) 

0 I MENS I 0’' TEl.,-iST (A0O) , ILAMI ClbT , TLAmx (6) 
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13203 

18300 

18400 

18530 

18830 

18703 

18300 

16900 

19000 

19100 

19200 

19300 

19400 

19500 

19600 

19700 

19300 

19903 

80103 
80200 
80303 
80403 
80503 
80603 
83700 
80833 
83903 
81303 
81100 
81200 
81303 
81403 
81500 
81630 
81703 
81303 
81903 
82030 
82133 
82200 
82303 
82400 
82500 
82603 
82733 
82803 
82900 
8300 3 
8310 3 
83200 

833 23 

834 yM 
835/0 
8360/ 
23700 
83330 
839/0 
84030 



COHr-lON/BLKTRN/UTPMAP, I AUPH, IRUANK 
CCnr^OM/eLKUAM/IELMST, ILAMi , ILA^^)^ 

OaTa laPACE/' V • SPFLAG/PI/ , NCHAR/0/ 



C OETi£RMIME if a CSP,'.‘iSP,OR PAUSE TO MARK TRAM3ITI0N 

C Ha3 occuped; if so ltr is ready for output: 

c 

ELMHATsIUftMl (lELMST (LTRn 
IXLaTLAUX (ELMHAT) 

IF CIXL,£Q. IXLaSTD go TO 700 
IF ( (IXL.EQ. n , AND. (LSTEUM.GE.an GO TO 10 
IF C (IXL.E 3 . 0 ) ,ANO. (LSTELM.tE.ai ) GO TO 700 
GO TO 700 



10 LTHhaTslSTLTR 

UrPOUTslALPHaTRPAPaTRHAT) ) 
NtUANK = IBLA'4K (LTPHAT) 
FU^’OUTsILaMI (IELMST (UTRmATI) 
GU TO 40 

type 5003,KLYQUT 
Sv;00 FQRnaT ( 1 X , T 1 , S) 

MCHARsNCHaP+1 



A0 



COMTIf^OE 

IFCLTRMAPCLrPHAT).£Q,43I 
IF CLTRMaP(LTRhaT) ,LE,aa) 
IFCLTRMAP(l_TRHATl.Lt.46) 
IF CLTRMaP (UTPHAT) .L.E.6'3) 
:FCLTRMAP(l.TRHAT),EQ,6n 
I.F (LTRMAPaTFhAT],FQ,'Sfe) 
GO TO S50 



GO TO 50 
GO TO 100 
GO TO 300 
GO TO 300 
GO TO 400 
GO 70 500 



50 IF CSPFLaG.EQ.O) go TO 100 

^^CH aPs'Ti 

TYPE 1500,LTROUT 

l5yK FORMAT (eX, A 1 ,/ ) 

SPFLAG*! 

Go TO S00 



100 MCHARsMCH(^R+ 1 

TYPE 1'00K,LTPUUT 
10 /0 form A T ( 1 X , A 1 , 51 

SFFl AGS0 

IF CnF>U AMfv ,EQ./ j GO TO 1.10 
SPFLAGs 1 

DO 110 l5l,ivPLANK 
MCUaR = ''C'^AR+ 1 
TrPE l000,ISPACt. 

1 1 J C u ‘-J T I U t 
GC TO A/0 



£.'00 ARsNCPAR+? 

Type 1 1 ../.ltrout 

11.10 format f IX , Ag, a) 

S F F L A G s 0 
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2H100 

2^300 

2H«00 

2<|520 

511600 


810 


2H700 

24900 

24900 


300 


25000 

25100 


15730 


25200 

25300 

25400 

25500 

25603 

25733 


310 


25800 

25900 

26000 


40U 


26103 

2o233 


1 3y 0 


26333 

26400 

26533 

J6600 


500 


26700 

26833 


1 


2tj900 

27300 

27100 

27200 


5G0 


27300 

27400 


17 00 


27530 

27600 

27703 

27800 

27900 

23303 

23100 


56 0 


23203 

23300 


6 00 


26a0i5> 

23500 

23600 


I6'.j0 


28700 

23330 

28900 


7 00 


29000 

29103 

29200 

29303 

29400 

29500 





IF (NaLAl'jK.tQ.fj) GU TU 310 
SPFuAG=l 

DC 210 I51,n6lank; 

NCH A»<aMCH AR+ 1 
TYPE 1006',ISPACE 
CUMT iNUfc 
GO TO *)<1M 

MCHARs.'^XHaP + ^i 
TY«E 120O,LTROUT 
format C2X, A3, 2X, 5) 

SPFLAGsl 

IF CN8LA,«iK ,eo,'i5) GO TO 310 
DC 310 l3l,NHLANK 
C >*1 A R a N C H A R + I 
lTP£ 1000,ISPAC£ 

CONTIiMUt 
GO TO . 

'JCH ARaNCHARt5 
TY»E 1300,1,TSOUT 
FURmaT(2X, a3,3Y, S) 

S«‘^LAGr 1 

0 I 0 F) 0 0 

* ■! C A R a 0 

IYFE laorT-.^I^TRQUT 
F DRr-'AT C/ , I '^X , a 2 , / , 1.0X) 
SPFUAGai 
GO TO hd^) 

MCHARaMCHnR+S 
type 1 , LTROUT 

forma T C2X , A3 » ?X , 

S ? F C A 0 5 0 

IF CNOLANX ,ei3,0) GO TO 560 
6PFUAGa I 

no 560 lal.i'.flLANK 

ochar = .ocmar*i 
Ty°E 1000,I5PACF 
f PNTlNUc 



IF (mChAR.lT ,521 GO TO 700 

’■Y?E 1600 
FQ ?^1AT (/ , 10X1 
NCMARS0 



T X I. A S T a 1 X L 

(.6 TELMstUH'RAY 

C5TlTR31.tr 
P h 1 U R M 

EfNO 
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Su3R0UTIM£ ZUUT5 



J01013 
0020'^ 
00300 
00400 
00500 
^ 00600 
‘ 0y700 
00800 
00400 
L. fll30»3 
^ 01105^ 
01209 
01300 
0140-3 
01509 
01600 
' 01700 
01830 
1 01400 
02<J00 
‘ 02100 
02290 
- 02300 
! 02400 
02500 
02630 
02730 
P23O0 
02930 
03990 
03130 
03200 
03330 
03400 
03500 
03630 
03700 
03800 
03400 
04930 
04100 
04200 
04300 
04400 
04500 
04600 

04 700 
04300 
-04400 
05300 
051 09 
05233 

05 3 0-0 
054 00 
05500 
05603 
057371 
^5300 

0593.3 

06903 






c 

C THIS SUyRCUTiNE CUNVFRTS THt INPUT SIGNAL AT 
C ^?aDIAN F«fcU WC TO 1000 HZ. 

C 

C***i*i*lr***Slt**li(**ir****l^)*lt*<t*i**i***«H*j»**<ti»<*1l5lti*H)>* 



CCMH0N/BLi<l/TAU/f3L»<2/wC 

data TH£TA/0,/,THLTLO/0,/ 

TH£T AsTHETA + -/(C*TAu 
ThETAsAMOD i:THETA,6,283191 

7.Is2IN*COS(THETA) 

ZQsZ IN*SIN CTHETa) 
ZII?SZIUP+.070*CZI-ZILP) 

zoLPszauP’^.e-70* czq-zolp) 

THErLasrHtTLQ♦^^253.^*TAU 
the FLOS ANOOC THE TLO, 6,23319) 

ZJUT= Z lLP*CnS(THETUO) +ZQLP*SIN (THETLO) 

«£ Turn 

E 'iO 



SUBROUTIMt yPFOET CZIN, Z) 

C*H**J!***«*lit*J»********»*1»**'****>»*l***'*t**********»**1>*llt*l**»**** 

c 

c This subroutine implements the bandpass filter and 
C envelope UETECTuR functions. The bpf is a simple cascade 
C OF TxQ 2-P0 l£ digital RESONATORS AT A CENTER FREQ OF 

C 1090 hZ, TH£ i.PF OF The envelope DETECTOR IS A 

c Three-pole cheoyschev 1.30 hz lpf. 
c 



dimension a (4) 

Data a / , 3333300^1 

Data C<l/1.37l'id/,CK2/,9aCP/,CG/,3l50/ 
OaTa Cl / I ,?7?fc/, C23 ,3100/ ,C/« 193?/ 

C 

C 3FF 13 T/0 E-POlE RESONATORS; 

C 

3 = w ? 

^ d-<^\ 
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061<30 

i| 640 ia 
06500 
06600 
06700 
06900 
06^00 
07000 
07100 
07200 
07300 
07430 
07500 
07630 
0 7 700 
07830 
07900 
08000 
08100 
03230 
38300 
03430 
08530 
33600 
08730 
03800 
089U0 
09030 
09100 
09230 
09300 
09400 
09500 
09600 
09700 
09830 
09930 
10003 
10133 
10233 
I03f)0 
10403 
13500 
10633 
10700 
10830 
19903 

11100 

11233 

11330 

Ua'30 

11530 

1163'3 

11703 

U 800 

11900 

12330 



WlsCl *i«i 2 »C 2*'4 3 + C*ZIf'i 

X 3 SX 2 

X2*Xl 

X 1 sCK 1 *X2-CK2»X3*CG»'.>11 
ZHPFsXl 



C 

C ENVt’LQPfi OErECTCR (SQUARE-UAW) : 
C SCJUAkF- 

c 

XUETsSGRT (ZBPF**2) 

C 

C UOn-PASS pilter- 

c 

■(' i = y 2 

YPs Y 1 
Y 1 = V 3 

V3 = X0ET*AU) 

Z3 = Z2 
7.2*21 
Z1 = Z 

Z = ''0 + 3 . * ( Y 1 + Y 21 i-Y 3 
Z=Z+A(2)*zi-AC3)*Z2-A(a)*23 



K F 7 U R N 
EMO 



S'JBRQuTI'ie NOISE (ZIM» R^, Z) 

C***’**t»**H5««***<t****i»i»**A***Hj^****<r**)k***H***)****'**1t**1t***t)lt** 

c 

C this SUBROuriNE ESTI.'IATfS ThF. NOTSE PO^fER IN THE 
r. E^YtLuP£ !)FlECTtO OUTr’Ur FOR USE BY THE »<ALMAN 

c filters, an estimate of the noise power is 

C Ai.30 SuaIRaCTEO FRO'’ T>^£ ENVELOPE DETECTED SIGNAL 
c IN ORCF.R TO produce A ZER 3 -NEAN nuTSE PROCESS 

r. AT ImE input to TriE mqpsE PROCESSOR, 

c 

C**«***<*i«'tKt*»*»*'******n***<t'******ilr*******'**^c**l>**'*t*1***'**i**K* 

Dl'^ENSTON YLONGC2U0) , YS<iORT(53) 

(UTa YLON'G/20O*1 . / , YShORT/St-i* 1 ,/ 

Data <l/i/,k<i./i/,i<s/1/,<k5/i/ 

^ATa ymini/ 1 ./, YNpJ2/l,/, ymavr/,'35/ 

M. = NL-rl 

Ir fKL.E0.23l 0 KL = l 
I' S 5 K S + 1 

TE(<S.EQ.5n'<Sai 

K K L s K r\ L + I 

IF (KKL.GE.2D0) KKLspcju 
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1210^^ 






I22af’ 




IF (KKS.G5.5e) KKSsSa 


12400 




IF CKKS.UF.a) GO TO 13 


12500 




TLQNG (KL) =ZI^ 


12500 




'^SHO'^I (^S) =ZIN 


12730 




Y h I ,si 1 s Z I M 


12600 




YMT-4aaZlM 


12400 

1J000 


13 


no 10a i=i»KKL 


13100 




IFCYLONGd) .GT.Y'-'INl) GO TO 100 


13200 




Yr‘, INI 3YLONG ( I ) 


13300 


130 


CQNTIMUt 


13400 

13500 




00 200 I=1,KKS 


13600 




IF ( YShOKT (IJ ,GT. YMIN2) GO TO 203 


13730 




Yi^lN2 = Y5MCi9TCn 


13600 


£0a 


CQNTiNUt 


13900 

14000 




YmJ'JsYMINI 


14100 




IF CYM1M2.lt. YMIMI ) YMIMsYMIM2 


14230 

14300 




Y M 4 VG s Y M A V G + , 33 4 * ( YH I N- Y M ft V G ) 


14400 

14500 




i-f 5 y . 3 1’' * Y n A '/ G 


14600 




IF («M.uT.'4.m 35) f9Ns3,305 


14700 




2sl , 1 * CZIN-2.a*YMAVG-.35) 


14800 

14900 




t?£ TuRim 


15000 




end 
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